Aug 20 06:28:57 devstack cinder-volume[83176]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 20 06:28:57 devstack cinder-volume[83176]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 20 06:28:57 devstack cinder-volume[83176]: we strongly recommend against using it for new projects. Aug 20 06:28:57 devstack cinder-volume[83176]: If you are already using Eventlet, we recommend migrating to a different Aug 20 06:28:57 devstack cinder-volume[83176]: framework. For more detail see Aug 20 06:28:57 devstack cinder-volume[83176]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 20 06:28:57 devstack cinder-volume[83176]: import eventlet # noqa Aug 20 06:29:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:29:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:29:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:29:01 devstack cinder-volume[83176]: INFO dbcounter [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Registered counter for database cinder Aug 20 06:29:01 devstack cinder-volume[83176]: DEBUG oslo_db.sqlalchemy.engines [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:29:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writer thread running {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:29:01 devstack cinder-volume[83176]: INFO cinder.rpc [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 20 06:29:01 devstack cinder-volume[83176]: INFO cinder.rpc [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_db.sqlalchemy.engines [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:29:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Determined volume DB was empty at startup. Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83176) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 20 06:29:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 20 06:29:02 devstack cinder-volume[83176]: WARNING stevedore.named [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 20 06:29:02 devstack cinder-volume[83176]: WARNING castellan.key_manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:29:02 devstack cinder-volume[83176]: WARNING cinder.keymgr.conf_key_mgr [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.lvm [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83176) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] CMD "cinder-rtstool verify" returned: 0 in 0.392s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_db.sqlalchemy.engines [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:29:02 devstack cinder-volume[83176]: INFO cinder.rpc [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 20 06:29:02 devstack cinder-volume[83176]: INFO cinder.rpc [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 20 06:29:02 devstack cinder-volume[83176]: WARNING stevedore.named [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 20 06:29:02 devstack cinder-volume[83176]: WARNING castellan.key_manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:29:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_db.sqlalchemy.engines [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:29:02 devstack cinder-volume[83176]: INFO oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Starting 1 workers Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Started child 83335 {{(pid=83176) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Full set of CONF: {{(pid=83176) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] ******************************************************************************** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Configuration options gathered from: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] ================================================================================ {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] allow_availability_zone_fallback = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] allow_compression_on_image_upload = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] allowed_direct_url_schemes = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] api_rate_limit = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] auth_strategy = keystone {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] az_cache_duration = 3600 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83335]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_availability_zone = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_host = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_stats_polling_interval = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backup_api_class = cinder.backup.api.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backup_name_template = backup-%s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backup_use_same_host = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backup_use_temp_snapshot = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] chap_password = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] chap_username = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_internal_tenant_project_id = 88291449da1e49a5a495d7562a5d4f3d {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_internal_tenant_user_id = 168cb41152d54c55bec72fb2b4d15155 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cloned_volume_same_az = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cluster = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] compression_format = gzip {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] compute_api_class = cinder.compute.nova.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] config_dir = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] config_source = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] control_exchange = openstack {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] debug = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] default_availability_zone = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] default_group_type = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] default_volume_type = lvmdriver-1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] disk_geometry = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_client_cert = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_client_cert_key = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_data_namespace = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_ssl_cert_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_ssl_cert_verify = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] driver_use_ssl = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] enable_force_upload = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] enable_new_services = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] enable_unsupported_driver = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] enabled_backends = ['lvmdriver-1'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] enforce_multipath_for_image_xfer = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] filter_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_api_insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_api_ssl_compression = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_ca_certificates_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_catalog_info = image:glance:publicURL {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_num_retries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance_request_timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] goodness_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] graceful_shutdown_timeout = 5 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] group_api_class = cinder.group.api.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] host = devstack {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_compress_on_upload = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_conversion_address_space_limit = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_conversion_cpu_limit = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_conversion_disable = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_upload_use_cinder_backend = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_upload_use_internal_tenant = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_volume_cache_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_volume_cache_max_count = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] image_volume_cache_max_size_gb = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] init_host_max_objects_retrieval = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] instance_format = [instance: %(uuid)s] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iscsi_target_flags = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iscsi_write_cache = on {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iser_helper = tgtadm {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iser_ip_address = 192.168.122.209 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iser_port = 3260 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_color = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_config_append = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_dir = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_options = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_rotate_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_rotate_interval_type = days {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] log_rotation_type = none {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] max_age = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] max_logfile_count = 30 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] max_logfile_size_mb = 200 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] max_over_subscription_ratio = 20.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] message_reap_interval = 86400 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] message_ttl = 2592000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] migration_create_volume_timeout_secs = 300 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] monkey_patch = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] monkey_patch_modules = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] my_ip = 192.168.122.209 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] no_snapshot_gb_quota = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] num_iser_scan_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] num_shell_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] num_volume_device_scan_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] nvmeof_conn_info_version = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] nvmet_ns_id = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] nvmet_port_id = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_max_limit = 1000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_ext_list = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_listen = 0.0.0.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_listen_port = 8776 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_use_ssl = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] osapi_volume_workers = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] per_volume_size_limit = -1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] periodic_fuzzy_delay = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] periodic_interval = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] project_id_regex = [0-9a-f\-]+ {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] public_endpoint = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] publish_errors = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_backup_gigabytes = 1000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_backups = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_gigabytes = 1000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_groups = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_snapshots = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] quota_volumes = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] rate_limit_burst = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] rate_limit_except_level = CRITICAL {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] rate_limit_interval = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] reinit_driver_count = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] replication_device = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] report_discard_supported = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] report_interval = 120 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] reservation_clean_interval = 86400 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] reservation_expire = 86400 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] reserved_image_namespaces = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] reserved_percentage = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] rpc_response_timeout = 120 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] run_external_periodic_tasks = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] scst_target_driver = iscsi {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] scst_target_iqn_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_down_time = 720 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] shell_completion = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] snapshot_name_template = snapshot-%s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] snapshot_same_host = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] split_loggers = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] state_path = /opt/stack/data/cinder {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] storage_availability_zone = nova {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] storage_protocol = iSCSI {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] syslog_log_facility = LOG_USER {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_helper = lioadm {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_ip_address = 192.168.122.209 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_port = 3260 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_protocol = iscsi {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] target_secondary_ip_addresses = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] trace_flags = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] transfer_api_class = cinder.transfer.api.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] transport_url = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] until_refresh = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_chap_auth = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_default_quota_class = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_journal = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_json = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_multipath_for_image_xfer = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83335]: INFO cinder.volume.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_stderr = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] use_syslog = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] verify_glance_signatures = enabled {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_api_class = cinder.volume.api.API {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_backend_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_clear = zero {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_clear_ionice = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_clear_size = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_copy_bps_limit = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_dd_blocksize = 1M {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_name_template = volume-%s {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_service_inithost_offload = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volume_usage_audit_period = month {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] zoning_mode = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_concurrency.disable_process_locking = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.auth_section = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.auth_type = password {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.auth_version = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.cache = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.delay_auth_decision = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.http_connect_timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:02 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.include_service_catalog = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.interface = public {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_password = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcache_username = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.region_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.service_token_roles_required = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.service_type = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.token_cache_time = 300 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.backend = dogpile.cache.null {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.backend_argument = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.backend_expiration_time = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.config_prefix = cache.oslo {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.debug_cache_backend = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.enable_retry_client = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.enable_socket_keepalive = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.expiration_time = 600 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.hashclient_retry_attempts = 2 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_dead_retry = 300 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_pool_maxsize = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_sasl_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.password = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.proxies = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.redis_db = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.redis_sentinel_service_name = mymaster {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.redis_server = localhost:6379 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.retry_attempts = 2 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.retry_delay = 0.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.socket_keepalive_count = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.socket_keepalive_idle = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.socket_keepalive_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.socket_timeout = 1.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.tls_allowed_ciphers = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.tls_cafile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.tls_certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.tls_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.tls_keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cache.username = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] coordination.backend_url = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.asyncio_connection = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.asyncio_slave_connection = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.backend = sqlalchemy {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.connection = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.connection_debug = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.connection_parameters = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.connection_recycle_time = 3600 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.connection_trace = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.db_inc_retry_interval = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.db_max_retries = 20 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.db_max_retry_interval = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.db_retry_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.max_overflow = 50 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.max_pool_size = 5 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.max_retries = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.mysql_wsrep_sync_wait = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.pool_timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.retry_interval = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.slave_connection = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.sqlite_synchronous = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.synchronous_reader = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] database.use_db_reconnect = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.connection_string = messaging:// {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.es_doc_type = notification {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.es_scroll_size = 10000 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.es_scroll_time = 2m {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.filter_error_trace = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.hmac_keys = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.sentinel_service_name = mymaster {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.socket_timeout = 0.1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.trace_requests = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler.trace_sqlalchemy = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler_jaeger.process_tags = {} {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler_jaeger.service_name_prefix = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] profiler_otlp.service_name_prefix = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.enforce_new_defaults = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.policy_default_rule = default {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.policy_file = policy.yaml {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_policy.remote_timeout = 60.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.group = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.helper_command = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] privsep_osbrick.user = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.group = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.helper_command = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] cinder_sys_admin.user = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.auth_section = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.auth_type = password {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.cafile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.collect_timing = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.send_service_user_token = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.split_loggers = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] service_user.timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.auth_section = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.auth_type = password {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.collect_timing = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.region_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.split_loggers = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] glance.timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.backend_availability_zone = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.chap_password = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.chap_username = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.disk_geometry = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_client_cert = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_client_cert_key = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_data_namespace = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.driver_use_ssl = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.enable_unsupported_driver = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.extra_capabilities = {} {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.filter_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.goodness_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iscsi_target_flags = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iscsi_write_cache = on {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iser_helper = tgtadm {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iser_port = 3260 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.lvm_mirrors = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.lvm_share_target = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.lvm_type = auto {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.num_shell_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.nvmet_port_id = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.replication_device = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.report_discard_supported = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.reserved_percentage = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.scst_target_driver = iscsi {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.scst_target_iqn_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.storage_protocol = iSCSI {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_helper = tgtadm {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_port = 3260 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_protocol = iscsi {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.trace_flags = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.unique_fqdn_network = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.use_chap_auth = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_backend_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_clear = zero {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_clear_ionice = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_clear_size = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volume_group = cinder-volumes {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_reports.file_event_handler = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_reports.log_dir = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.backend_availability_zone = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.backend_host = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.chap_password = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.chap_username = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.chiscsi_conf = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.disk_geometry = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_client_cert = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_data_namespace = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.driver_use_ssl = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.extra_capabilities = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.filter_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.goodness_function = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iser_helper = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack sudo[83343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iser_ip_address = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iser_port = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.iser_target_prefix = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.lvm_conf_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.lvm_mirrors = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.lvm_share_target = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.lvm_type = auto {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.num_shell_tries = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.nvmet_port_id = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.replication_device = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.report_discard_supported = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.reserved_percentage = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.scst_target_driver = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.storage_protocol = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_helper = lioadm {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_ip_address = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_port = 3260 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_protocol = iscsi {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.trace_flags = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.use_chap_auth = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_clear = zero {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_clear_size = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] lvmdriver-1.volumes_dir = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.ssl_version = {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_notifications.driver = [] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_notifications.retry = -1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] oslo_messaging_notifications.transport_url = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] key_manager.fixed_key = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.barbican_api_version = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.barbican_endpoint = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.barbican_endpoint_type = public {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.barbican_region_name = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.cafile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.collect_timing = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.number_of_retries = 60 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.retry_delay = 1 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.send_service_user_token = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.split_loggers = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.verify_ssl = True {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican.verify_ssl_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.auth_section = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.auth_type = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.cafile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.certfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.collect_timing = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.insecure = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.keyfile = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.split_loggers = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] barbican_service_user.timeout = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.approle_role_id = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.approle_secret_id = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.auth_method = approle {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.auth_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.kv_mountpoint = secret {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.kv_path = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.kv_version = 2 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.namespace = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.root_token_id = **** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.ssl_ca_crt_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.timeout = 60.0 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.token_file = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.token_role = None {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.use_ssl = False {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:29:03 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] ******************************************************************************** {{(pid=83176) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 20 06:29:03 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack sudo[83388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:03 devstack sudo[83388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:03 devstack sudo[83388]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.351s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:29:03 devstack cinder-volume[83335]: INFO cinder.brick.local_dev.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:03 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:03 devstack sudo[83521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:03 devstack sudo[83521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:04 devstack sudo[83521]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG cinder.brick.local_dev.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83335) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:04 devstack sudo[83626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:04 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:04 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:04 devstack sudo[83805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:04 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:04 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:04 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:04 devstack sudo[83948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 20 06:29:04 devstack sudo[83948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:05 devstack sudo[83948]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:05 devstack sudo[83953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:05 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:05 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:05 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:05 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:05 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:05 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:05 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:05 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:05 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:05 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:05 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:06 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:06 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:06 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:06 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:06 devstack cinder-volume[83335]: INFO cinder.volume.drivers.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:06 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:06 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:06 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:29:06 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:06 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:06 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:07 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:07 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:07 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:07 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:07 devstack sudo[84153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:07 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:07 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:07 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:07 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:07 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:07 devstack cinder-volume[83335]: INFO cinder.volume.driver [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Driver hasn't implemented _init_vendor_properties() Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG cinder.volume.driver [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83335) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG oslo_db.sqlalchemy.engines [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writer thread running {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:29:07 devstack cinder-volume[83335]: DEBUG cinder.db.api [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Building query based on filter {{(pid=83335) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG cinder.image.image_utils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83335) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 20 06:29:08 devstack cinder-volume[83335]: INFO cinder.keymgr.migration [None req-cca0e6c2-9efc-49ca-8f24-215ee5b70bce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:08 devstack sudo[84159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:08 devstack sudo[84159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:08 devstack sudo[84159]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:08 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:08 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:08 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:08 devstack sudo[84167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:08 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:08 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:08 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:08 devstack sudo[84171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:08 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:09 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG cinder.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Notifying Schedulers of capabilities ... {{(pid=83335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:29:09 devstack cinder-volume[83335]: INFO cinder.volume.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Driver initialization completed successfully. Aug 20 06:29:09 devstack cinder-volume[83335]: INFO cinder.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Initiating service 2 cleanup Aug 20 06:29:09 devstack cinder-volume[83335]: INFO cinder.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Service 2 cleanup completed. Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG cinder.service [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Creating RPC server for service cinder-volume {{(pid=83335) start /opt/stack/cinder/cinder/service.py:231}} Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG cinder.service [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83335) start /opt/stack/cinder/cinder/service.py:237}} Aug 20 06:29:09 devstack cinder-volume[83335]: INFO cinder.volume.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:09 devstack sudo[84176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:29:09 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:09 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:09 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:09 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:09 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:09 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:09 devstack sudo[84182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:29:09 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:10 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:10 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:10 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:29:10 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:29:10 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:29:10 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Aug 20 06:29:10 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:29:10 devstack cinder-volume[83335]: INFO cinder.volume.manager [None req-c5205462-8acc-4e21-bc41-b1072dfd5759 None None] Driver post RPC initialization completed successfully. Aug 20 06:29:12 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:29:20 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writing DB stats cinder:SELECT=3 {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:29:20 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:29:35 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager._thread_info {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:29:35 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread count: 6 {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:29:35 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread info: [<_MainThread(MainThread, started 138762656391296)>, , , , , ] {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-95419777-f52f-496c-9331-ff6054923632 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:30:35 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:30:35 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:30:35 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:30:35 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:30:35 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:30:35 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:30:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:30:35 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:30:35 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:30:36 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:30:36 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:30:36 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:30:36 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG cinder.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] Notifying Schedulers of capabilities ... {{(pid=83335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager._thread_info {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread count: 6 {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:30:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread info: [<_MainThread(MainThread, started 138762656391296)>, , , , , ] {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:31:20 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-95419777-f52f-496c-9331-ff6054923632 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:31:35 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:31:35 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:31:35 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:31:35 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:31:35 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:31:35 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:31:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:31:35 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:31:35 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:31:36 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:31:36 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:31:36 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:31:36 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG cinder.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] Notifying Schedulers of capabilities ... {{(pid=83335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager._thread_info {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread count: 6 {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:31:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread info: [<_MainThread(MainThread, started 138762656391296)>, , , , , ] {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG cinder.volume.drivers.lvm [None req-95419777-f52f-496c-9331-ff6054923632 None None] Updating volume stats {{(pid=83335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:32:35 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 20 06:32:35 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:32:35 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:32:35 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:32:35 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:32:35 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:32:35 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:32:35 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 20 06:32:35 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:32:36 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:32:36 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 20 06:32:36 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:32:36 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG oslo_concurrency.processutils [None req-95419777-f52f-496c-9331-ff6054923632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=83335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG cinder.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] Notifying Schedulers of capabilities ... {{(pid=83335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG oslo_service.periodic_task [None req-95419777-f52f-496c-9331-ff6054923632 None None] Running periodic task VolumeManager._thread_info {{(pid=83335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread count: 6 {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:32:36 devstack cinder-volume[83335]: DEBUG cinder.volume.manager [None req-95419777-f52f-496c-9331-ff6054923632 None None] thread info: [<_MainThread(MainThread, started 138762656391296)>, , , , , ] {{(pid=83335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:33:20 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writing DB stats cinder:SELECT=1 {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:33:20 devstack cinder-volume[83335]: DEBUG dbcounter [-] [83335] Writing DB stats cinder:UPDATE=1 {{(pid=83335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:33:26 devstack cinder-volume[83176]: INFO oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Caught SIGTERM, stopping children Aug 20 06:33:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Acquiring lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Acquired lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Releasing lock "singleton_lock" {{(pid=83176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:26 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Stop services. {{(pid=83176) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 20 06:33:26 devstack cinder-volume[83176]: DEBUG oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Killing children. {{(pid=83176) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 20 06:33:26 devstack cinder-volume[83176]: INFO oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Waiting on 1 children to exit Aug 20 06:33:29 devstack cinder-volume[83335]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Acquiring lock "singleton_lock" {{(pid=83335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:29 devstack cinder-volume[83335]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Acquired lock "singleton_lock" {{(pid=83335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:29 devstack cinder-volume[83335]: DEBUG oslo_concurrency.lockutils [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Releasing lock "singleton_lock" {{(pid=83335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:29 devstack cinder-volume[83335]: WARNING amqp [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 20 06:33:29 devstack cinder-volume[83335]: WARNING amqp [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 20 06:33:29 devstack cinder-volume[83176]: INFO oslo_service.backend._eventlet.service [None req-0baf6897-af5c-4da7-bfa6-2666dc2979fa None None] Child 83335 exited with status 0 Aug 20 06:33:29 devstack cinder-volume[93401]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 20 06:33:29 devstack cinder-volume[93401]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 20 06:33:29 devstack cinder-volume[93401]: we strongly recommend against using it for new projects. Aug 20 06:33:29 devstack cinder-volume[93401]: If you are already using Eventlet, we recommend migrating to a different Aug 20 06:33:29 devstack cinder-volume[93401]: framework. For more detail see Aug 20 06:33:29 devstack cinder-volume[93401]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 20 06:33:29 devstack cinder-volume[93401]: import eventlet # noqa Aug 20 06:33:31 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:31 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:31 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:32 devstack cinder-volume[93401]: INFO dbcounter [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Registered counter for database cinder Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_db.sqlalchemy.engines [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG dbcounter [-] [93401] Writer thread running {{(pid=93401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:33:32 devstack cinder-volume[93401]: INFO cinder.rpc [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 20 06:33:32 devstack cinder-volume[93401]: INFO cinder.rpc [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_db.sqlalchemy.engines [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:32 devstack cinder-volume[93401]: INFO cinder.volume.manager [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Determined volume DB was empty at startup. Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG cinder.volume.manager [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93401) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 20 06:33:32 devstack cinder-volume[93401]: INFO cinder.volume.manager [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 20 06:33:32 devstack cinder-volume[93401]: WARNING stevedore.named [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 20 06:33:32 devstack cinder-volume[93401]: WARNING castellan.key_manager [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:33:32 devstack cinder-volume[93401]: WARNING cinder.keymgr.conf_key_mgr [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:33:32 devstack cinder-volume[93401]: INFO cinder.volume.manager [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_db.sqlalchemy.engines [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:32 devstack cinder-volume[93401]: INFO oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Starting 1 workers Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Started child 93616 {{(pid=93401) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Full set of CONF: {{(pid=93401) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] ******************************************************************************** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Configuration options gathered from: {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] ================================================================================ {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] allow_availability_zone_fallback = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] allow_compression_on_image_upload = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] allowed_direct_url_schemes = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] api_rate_limit = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] auth_strategy = keystone {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_availability_zone = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_host = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_stats_polling_interval = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backup_api_class = cinder.backup.api.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backup_name_template = backup-%s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backup_use_same_host = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backup_use_temp_snapshot = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] chap_password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] chap_username = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:32 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_internal_tenant_project_id = 88291449da1e49a5a495d7562a5d4f3d {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_internal_tenant_user_id = 168cb41152d54c55bec72fb2b4d15155 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cluster = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] compression_format = gzip {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] compute_api_class = cinder.compute.nova.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] config_dir = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] config_source = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] control_exchange = openstack {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] debug = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] default_availability_zone = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] default_group_type = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] default_volume_type = QuobyteHD {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] disk_geometry = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_client_cert = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_client_cert_key = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_data_namespace = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_ssl_cert_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_ssl_cert_verify = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] driver_use_ssl = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] enable_new_services = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] enable_unsupported_driver = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] enabled_backends = ['QuobyteHD'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93616]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] enforce_multipath_for_image_xfer = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] filter_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_api_insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_api_ssl_compression = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_ca_certificates_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_catalog_info = image:glance:publicURL {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_num_retries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance_request_timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] goodness_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] graceful_shutdown_timeout = 5 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] group_api_class = cinder.group.api.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] host = devstack {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_compress_on_upload = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_conversion_address_space_limit = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_conversion_cpu_limit = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_conversion_disable = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_upload_use_cinder_backend = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_upload_use_internal_tenant = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_volume_cache_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_volume_cache_max_count = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] image_volume_cache_max_size_gb = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] init_host_max_objects_retrieval = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] instance_format = [instance: %(uuid)s] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iscsi_target_flags = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iscsi_write_cache = on {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iser_helper = tgtadm {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iser_ip_address = 192.168.122.209 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iser_port = 3260 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_color = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_config_append = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_dir = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_options = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_rotate_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_rotate_interval_type = days {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] log_rotation_type = none {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] max_age = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] max_logfile_count = 30 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] max_logfile_size_mb = 200 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] max_over_subscription_ratio = 20.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] message_reap_interval = 86400 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] message_ttl = 2592000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] migration_create_volume_timeout_secs = 300 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] monkey_patch = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] monkey_patch_modules = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] my_ip = 192.168.122.209 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] no_snapshot_gb_quota = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] num_iser_scan_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] num_shell_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] num_volume_device_scan_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] nvmeof_conn_info_version = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] nvmet_ns_id = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] nvmet_port_id = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_max_limit = 1000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_ext_list = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_listen = 0.0.0.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_listen_port = 8776 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_use_ssl = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] osapi_volume_workers = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] per_volume_size_limit = -1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] periodic_fuzzy_delay = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] periodic_interval = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] project_id_regex = [0-9a-f\-]+ {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] public_endpoint = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] publish_errors = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_backup_gigabytes = 1000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_backups = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_gigabytes = 1000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_groups = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_snapshots = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] quota_volumes = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] rate_limit_burst = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] rate_limit_except_level = CRITICAL {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] rate_limit_interval = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] reinit_driver_count = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] replication_device = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] report_discard_supported = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] report_interval = 120 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] reservation_clean_interval = 86400 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] reservation_expire = 86400 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] reserved_image_namespaces = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] reserved_percentage = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] rpc_response_timeout = 120 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] run_external_periodic_tasks = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] scst_target_driver = iscsi {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] scst_target_iqn_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_down_time = 720 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] shell_completion = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] snapshot_name_template = snapshot-%s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] split_loggers = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] state_path = /opt/stack/data/cinder {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] storage_availability_zone = nova {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] storage_protocol = iSCSI {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] syslog_log_facility = LOG_USER {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_helper = lioadm {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_ip_address = 192.168.122.209 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_port = 3260 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_protocol = iscsi {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] target_secondary_ip_addresses = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] trace_flags = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] transfer_api_class = cinder.transfer.api.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] transport_url = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] until_refresh = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_chap_auth = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_default_quota_class = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_journal = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_json = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_multipath_for_image_xfer = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_stderr = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] use_syslog = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Starting volume driver QuobyteDriver (1.2) Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] verify_glance_signatures = enabled {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_api_class = cinder.volume.api.API {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_backend_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_clear = zero {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_clear_ionice = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_clear_size = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93616) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_copy_bps_limit = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_dd_blocksize = 1M {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_name_template = volume-%s {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_service_inithost_offload = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volume_usage_audit_period = month {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] zoning_mode = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_concurrency.disable_process_locking = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.auth_section = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.auth_type = password {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.auth_version = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.cache = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.delay_auth_decision = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.http_connect_timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.include_service_catalog = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.interface = public {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_password = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcache_username = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.region_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.service_token_roles_required = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.service_type = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.token_cache_time = 300 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.backend = dogpile.cache.null {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.backend_argument = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.backend_expiration_time = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.config_prefix = cache.oslo {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.debug_cache_backend = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.enable_retry_client = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.enable_socket_keepalive = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.expiration_time = 600 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.hashclient_retry_attempts = 2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_dead_retry = 300 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_pool_maxsize = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_sasl_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.proxies = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.redis_db = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.redis_sentinel_service_name = mymaster {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.redis_server = localhost:6379 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.retry_attempts = 2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.retry_delay = 0.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.socket_keepalive_count = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.socket_keepalive_idle = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.socket_keepalive_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.socket_timeout = 1.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.tls_allowed_ciphers = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.tls_cafile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.tls_certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.tls_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.tls_keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cache.username = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] coordination.backend_url = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.asyncio_connection = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.asyncio_slave_connection = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.backend = sqlalchemy {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.connection = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.connection_debug = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.connection_parameters = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.connection_recycle_time = 3600 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.connection_trace = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.db_inc_retry_interval = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.db_max_retries = 20 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.db_max_retry_interval = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.db_retry_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.max_overflow = 50 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.max_pool_size = 5 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.max_retries = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.mysql_wsrep_sync_wait = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.pool_timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.retry_interval = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.slave_connection = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.sqlite_synchronous = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.synchronous_reader = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] database.use_db_reconnect = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.connection_string = messaging:// {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.es_doc_type = notification {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.es_scroll_size = 10000 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.es_scroll_time = 2m {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.filter_error_trace = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.hmac_keys = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.sentinel_service_name = mymaster {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.socket_timeout = 0.1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.trace_requests = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler.trace_sqlalchemy = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler_jaeger.process_tags = {} {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler_jaeger.service_name_prefix = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] profiler_otlp.service_name_prefix = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.enforce_new_defaults = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.policy_default_rule = default {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.policy_file = policy.yaml {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_policy.remote_timeout = 60.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.group = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.helper_command = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] privsep_osbrick.user = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.group = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.helper_command = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] cinder_sys_admin.user = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.auth_section = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.auth_type = password {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.cafile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.collect_timing = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.send_service_user_token = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.split_loggers = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] service_user.timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.auth_section = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.auth_type = password {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.collect_timing = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.region_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.split_loggers = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] glance.timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.backend_availability_zone = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.chap_password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.chap_username = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.disk_geometry = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_client_cert = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_client_cert_key = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_data_namespace = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.driver_use_ssl = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.enable_unsupported_driver = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.extra_capabilities = {} {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.filter_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.goodness_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iscsi_target_flags = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iscsi_write_cache = on {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iser_helper = tgtadm {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iser_port = 3260 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_host = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_login = admin {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_mount_options = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_private_key = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_share_path = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_ssh_port = 22 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.num_shell_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.nvmet_port_id = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_client_cfg = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.quobyte_volume_url = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.replication_device = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.report_discard_supported = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.reserved_percentage = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.scst_target_driver = iscsi {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.scst_target_iqn_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.storage_protocol = iSCSI {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_helper = tgtadm {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_port = 3260 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_protocol = iscsi {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.trace_flags = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.unique_fqdn_network = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.use_chap_auth = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_backend_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_clear = zero {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_clear_ionice = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_clear_size = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_reports.file_event_handler = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_reports.log_dir = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.backend_availability_zone = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.backend_host = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.chap_password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.chap_username = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.chiscsi_conf = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.disk_geometry = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93616) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 20 06:33:33 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_client_cert = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_client_cert_key = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_data_namespace = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.driver_use_ssl = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.extra_capabilities = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Running cmd (subprocess): mount.quobyte {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.filter_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.goodness_function = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iscsi_target_flags = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iscsi_write_cache = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iser_helper = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iser_ip_address = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iser_port = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.iser_target_prefix = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_host = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_login = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_mount_options = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_password = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_private_key = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_share_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_ssh_port = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.num_shell_tries = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nvmet_ns_id = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.nvmet_port_id = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.replication_device = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.report_discard_supported = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.reserved_percentage = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.scst_target_driver = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.storage_protocol = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_helper = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_ip_address = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_port = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_prefix = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_protocol = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.trace_flags = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.unique_fqdn_network = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.use_chap_auth = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_clear = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_clear_ionice = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_clear_size = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] QuobyteHD.volumes_dir = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.ssl_version = {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_notifications.driver = [] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_notifications.retry = -1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] oslo_messaging_notifications.transport_url = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] key_manager.fixed_key = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.barbican_api_version = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.barbican_endpoint = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.barbican_endpoint_type = public {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.barbican_region_name = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.cafile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.collect_timing = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.number_of_retries = 60 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.retry_delay = 1 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.send_service_user_token = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.split_loggers = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.verify_ssl = True {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican.verify_ssl_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.auth_section = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.auth_type = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.cafile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.certfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.collect_timing = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.insecure = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.keyfile = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.split_loggers = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] barbican_service_user.timeout = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.approle_role_id = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.approle_secret_id = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.auth_method = approle {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.auth_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.kv_mountpoint = secret {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.kv_path = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.kv_version = 2 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.namespace = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.root_token_id = **** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.ssl_ca_crt_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.timeout = 60.0 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.token_file = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.token_role = None {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.use_ssl = False {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:33 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] ******************************************************************************** {{(pid=93401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 20 06:33:33 devstack quobyte-client[93617]: Reading configuration file: /etc/quobyte/client.cfg Aug 20 06:33:33 devstack quobyte-client[93617]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:33 devstack cinder-volume[93616]: INFO cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 ... Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b -c /etc/quobyte/client-cinder.cfg {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:33 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b -c /etc/quobyte/client-cinder.cfg Aug 20 06:33:33 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:33 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.353s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:33 devstack cinder-volume[93616]: INFO cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 succeeded Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.367s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:33 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:33 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:33 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.242s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:33 devstack cinder-volume[93616]: INFO cinder.volume.driver [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Driver hasn't implemented _init_vendor_properties() Aug 20 06:33:33 devstack cinder-volume[93616]: DEBUG cinder.volume.driver [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.346622467041, 'free_capacity_gb': 1775.346622467041, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93616) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_db.sqlalchemy.engines [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writer thread running {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.db.api [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Building query based on filter {{(pid=93616) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93616) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.keymgr.migration [None req-3b7e35dd-1d1a-4b30-8ad7-f2d033f422ab None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:34 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:34 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:34 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.231s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Driver initialization completed successfully. Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Initiating service 3 cleanup Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Service 3 cleanup completed. Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.service [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Creating RPC server for service cinder-volume {{(pid=93616) start /opt/stack/cinder/cinder/service.py:231}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.service [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93616) start /opt/stack/cinder/cinder/service.py:237}} Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:34 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:34 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:34 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.273s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fbd32d0a-58c8-41f7-81bc-c5aa82d3eef6 None None] Driver post RPC initialization completed successfully. Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:39 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:39 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:39 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.237s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:39 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-19061338-f9fe-4ada-bc8b-54fa5e8cf430 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:33:39 devstack cinder-volume[93401]: INFO oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Caught SIGTERM, stopping children Aug 20 06:33:39 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Acquiring lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:39 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Acquired lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:39 devstack cinder-volume[93401]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Releasing lock "singleton_lock" {{(pid=93401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:39 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Stop services. {{(pid=93401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 20 06:33:39 devstack cinder-volume[93401]: DEBUG oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Killing children. {{(pid=93401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 20 06:33:39 devstack cinder-volume[93401]: INFO oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Waiting on 1 children to exit Aug 20 06:33:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Acquiring lock "singleton_lock" {{(pid=93616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Acquired lock "singleton_lock" {{(pid=93616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Releasing lock "singleton_lock" {{(pid=93616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:42 devstack cinder-volume[93616]: WARNING amqp [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 20 06:33:42 devstack cinder-volume[93616]: WARNING amqp [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 20 06:33:42 devstack cinder-volume[93401]: INFO oslo_service.backend._eventlet.service [None req-90f9e7e8-0839-41d9-9256-b943033c723e None None] Child 93616 exited with status 0 Aug 20 06:33:43 devstack cinder-volume[93935]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 20 06:33:43 devstack cinder-volume[93935]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 20 06:33:43 devstack cinder-volume[93935]: we strongly recommend against using it for new projects. Aug 20 06:33:43 devstack cinder-volume[93935]: If you are already using Eventlet, we recommend migrating to a different Aug 20 06:33:43 devstack cinder-volume[93935]: framework. For more detail see Aug 20 06:33:43 devstack cinder-volume[93935]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 20 06:33:43 devstack cinder-volume[93935]: import eventlet # noqa Aug 20 06:33:46 devstack cinder-volume[93935]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 20 06:33:46 devstack cinder-volume[93935]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 20 06:33:46 devstack cinder-volume[93935]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 20 06:33:47 devstack cinder-volume[93935]: INFO dbcounter [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Registered counter for database cinder Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_db.sqlalchemy.engines [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG dbcounter [-] [93935] Writer thread running {{(pid=93935) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:33:47 devstack cinder-volume[93935]: INFO cinder.rpc [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 20 06:33:47 devstack cinder-volume[93935]: INFO cinder.rpc [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_db.sqlalchemy.engines [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:47 devstack cinder-volume[93935]: INFO cinder.volume.manager [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Determined volume DB was empty at startup. Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG cinder.volume.manager [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93935) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 20 06:33:47 devstack cinder-volume[93935]: WARNING stevedore.named [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 20 06:33:47 devstack cinder-volume[93935]: WARNING castellan.key_manager [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:33:47 devstack cinder-volume[93935]: WARNING cinder.keymgr.conf_key_mgr [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 20 06:33:47 devstack cinder-volume[93935]: INFO cinder.volume.manager [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_db.sqlalchemy.engines [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:47 devstack cinder-volume[93935]: INFO oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Starting 1 workers Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Started child 94234 {{(pid=93935) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Full set of CONF: {{(pid=93935) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] ******************************************************************************** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] Configuration options gathered from: {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] ================================================================================ {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] allow_availability_zone_fallback = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] allow_compression_on_image_upload = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] allowed_direct_url_schemes = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] api_rate_limit = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] auth_strategy = keystone {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_availability_zone = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_host = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_stats_polling_interval = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backup_api_class = cinder.backup.api.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backup_name_template = backup-%s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[94234]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backup_use_same_host = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backup_use_temp_snapshot = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] chap_password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] chap_username = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_internal_tenant_project_id = 88291449da1e49a5a495d7562a5d4f3d {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_internal_tenant_user_id = 168cb41152d54c55bec72fb2b4d15155 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cluster = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] compression_format = gzip {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:47 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] compute_api_class = cinder.compute.nova.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] config_dir = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] config_source = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] control_exchange = openstack {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] debug = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] default_availability_zone = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] default_group_type = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] default_volume_type = QuobyteHD {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] disk_geometry = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_client_cert = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_client_cert_key = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_data_namespace = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_ssl_cert_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_ssl_cert_verify = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] driver_use_ssl = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] enable_new_services = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] enable_unsupported_driver = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] enabled_backends = ['QuobyteHD'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] enforce_multipath_for_image_xfer = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] filter_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_api_insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_api_ssl_compression = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_ca_certificates_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_catalog_info = image:glance:publicURL {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_num_retries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance_request_timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] goodness_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] graceful_shutdown_timeout = 5 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] group_api_class = cinder.group.api.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] host = devstack {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_compress_on_upload = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_conversion_address_space_limit = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_conversion_cpu_limit = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_conversion_disable = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_upload_use_cinder_backend = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_upload_use_internal_tenant = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_volume_cache_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_volume_cache_max_count = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] image_volume_cache_max_size_gb = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] init_host_max_objects_retrieval = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] instance_format = [instance: %(uuid)s] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iscsi_target_flags = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iscsi_write_cache = on {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iser_helper = tgtadm {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iser_ip_address = 192.168.122.209 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iser_port = 3260 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_color = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_config_append = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_dir = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_options = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_rotate_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_rotate_interval_type = days {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] log_rotation_type = none {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] max_age = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] max_logfile_count = 30 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] max_logfile_size_mb = 200 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] max_over_subscription_ratio = 20.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] message_reap_interval = 86400 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] message_ttl = 2592000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] migration_create_volume_timeout_secs = 300 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] monkey_patch = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] monkey_patch_modules = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] my_ip = 192.168.122.209 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] no_snapshot_gb_quota = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] num_iser_scan_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] num_shell_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] num_volume_device_scan_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] nvmeof_conn_info_version = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] nvmet_ns_id = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] nvmet_port_id = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_max_limit = 1000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_ext_list = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Starting volume driver QuobyteDriver (1.2) Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_listen_port = 8776 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_use_ssl = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] osapi_volume_workers = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] per_volume_size_limit = -1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] periodic_fuzzy_delay = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] periodic_interval = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] public_endpoint = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] publish_errors = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_backup_gigabytes = 1000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_backups = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94234) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_gigabytes = 1000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_groups = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_snapshots = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] quota_volumes = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] rate_limit_burst = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] rate_limit_except_level = CRITICAL {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] rate_limit_interval = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] reinit_driver_count = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] replication_device = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] report_discard_supported = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] report_interval = 120 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] reservation_clean_interval = 86400 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] reservation_expire = 86400 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] reserved_image_namespaces = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] reserved_percentage = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] rpc_response_timeout = 120 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] run_external_periodic_tasks = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] scst_target_driver = iscsi {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] scst_target_iqn_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_down_time = 720 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] shell_completion = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] snapshot_name_template = snapshot-%s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] split_loggers = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] state_path = /opt/stack/data/cinder {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] storage_availability_zone = nova {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] storage_protocol = iSCSI {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] syslog_log_facility = LOG_USER {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_helper = lioadm {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_ip_address = 192.168.122.209 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_port = 3260 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_protocol = iscsi {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] target_secondary_ip_addresses = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] trace_flags = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] transport_url = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] until_refresh = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_chap_auth = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_default_quota_class = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_journal = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_json = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_multipath_for_image_xfer = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_stderr = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] use_syslog = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] verify_glance_signatures = enabled {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_api_class = cinder.volume.api.API {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_backend_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_clear = zero {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_clear_ionice = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_clear_size = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_copy_bps_limit = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_dd_blocksize = 1M {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_name_template = volume-%s {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_service_inithost_offload = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volume_usage_audit_period = month {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] zoning_mode = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_concurrency.disable_process_locking = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.auth_section = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.auth_type = password {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.auth_version = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.cache = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.include_service_catalog = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.interface = public {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_password = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcache_username = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.region_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.service_type = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.backend = dogpile.cache.null {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.backend_argument = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.backend_expiration_time = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.config_prefix = cache.oslo {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.debug_cache_backend = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.enable_retry_client = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.enable_socket_keepalive = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.expiration_time = 600 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.hashclient_retry_attempts = 2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_dead_retry = 300 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_pool_maxsize = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_sasl_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.proxies = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.redis_db = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.redis_server = localhost:6379 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.retry_attempts = 2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.retry_delay = 0.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.socket_keepalive_count = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.socket_keepalive_idle = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.socket_keepalive_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.socket_timeout = 1.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.tls_allowed_ciphers = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.tls_cafile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.tls_certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.tls_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.tls_keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cache.username = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] coordination.backend_url = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.asyncio_connection = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.asyncio_slave_connection = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.backend = sqlalchemy {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.connection = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.connection_debug = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.connection_parameters = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.connection_recycle_time = 3600 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.connection_trace = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.db_inc_retry_interval = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.db_max_retries = 20 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.db_max_retry_interval = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.db_retry_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.max_overflow = 50 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.max_pool_size = 5 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.max_retries = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.mysql_wsrep_sync_wait = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.pool_timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.retry_interval = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.slave_connection = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.sqlite_synchronous = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.synchronous_reader = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] database.use_db_reconnect = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.connection_string = messaging:// {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.es_doc_type = notification {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.es_scroll_size = 10000 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.es_scroll_time = 2m {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.filter_error_trace = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.hmac_keys = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.sentinel_service_name = mymaster {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.socket_timeout = 0.1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.trace_requests = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler.trace_sqlalchemy = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler_jaeger.process_tags = {} {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler_jaeger.service_name_prefix = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] profiler_otlp.service_name_prefix = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.enforce_new_defaults = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.policy_default_rule = default {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.policy_file = policy.yaml {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.group = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.helper_command = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] privsep_osbrick.user = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.group = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.helper_command = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] cinder_sys_admin.user = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.auth_section = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.auth_type = password {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.cafile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.collect_timing = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.send_service_user_token = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.split_loggers = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] service_user.timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.auth_section = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.auth_type = password {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.collect_timing = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.region_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.split_loggers = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] glance.timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.backend_availability_zone = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.chap_password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.chap_username = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.disk_geometry = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_client_cert = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_client_cert_key = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_data_namespace = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.driver_use_ssl = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.extra_capabilities = {} {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.filter_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.goodness_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iscsi_target_flags = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iscsi_write_cache = on {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iser_helper = tgtadm {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iser_port = 3260 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_host = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_login = admin {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_mount_options = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_private_key = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_share_path = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.num_shell_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.quobyte_volume_url = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.replication_device = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.report_discard_supported = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.reserved_percentage = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_helper = tgtadm {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_port = 3260 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_protocol = iscsi {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.trace_flags = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.unique_fqdn_network = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.use_chap_auth = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_backend_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_clear = zero {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_clear_ionice = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_clear_size = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_reports.file_event_handler = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_reports.log_dir = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.backend_availability_zone = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.backend_host = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.chap_password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.chap_username = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.chiscsi_conf = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.disk_geometry = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_client_cert = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_data_namespace = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.driver_use_ssl = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.extra_capabilities = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.filter_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.goodness_function = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iser_helper = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iser_ip_address = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iser_port = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.iser_target_prefix = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_host = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_login = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_mount_options = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_password = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94234) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 20 06:33:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 20 06:33:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_private_key = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_share_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Running cmd (subprocess): mount.quobyte {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_ssh_port = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.num_shell_tries = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.nvmet_port_id = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.replication_device = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.report_discard_supported = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.reserved_percentage = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.scst_target_driver = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.storage_protocol = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_helper = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_ip_address = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_port = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_prefix = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_protocol = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.trace_flags = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.use_chap_auth = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_clear = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_clear_size = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] QuobyteHD.volumes_dir = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack quobyte-client[94242]: Reading configuration file: /etc/quobyte/client.cfg Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack quobyte-client[94242]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_notifications.driver = [] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_notifications.retry = -1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] key_manager.fixed_key = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.barbican_api_version = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.barbican_endpoint = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.barbican_endpoint_type = public {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.barbican_region_name = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.cafile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.collect_timing = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.number_of_retries = 60 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.retry_delay = 1 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.send_service_user_token = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.split_loggers = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.verify_ssl = True {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican.verify_ssl_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.auth_section = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.auth_type = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.cafile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.certfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.collect_timing = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.insecure = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.keyfile = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.split_loggers = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] barbican_service_user.timeout = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.approle_role_id = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.approle_secret_id = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.auth_method = approle {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.auth_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.kv_mountpoint = secret {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.kv_path = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.kv_version = 2 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.namespace = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.root_token_id = **** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.ssl_ca_crt_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.timeout = 60.0 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.token_file = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.token_role = None {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.use_ssl = False {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 20 06:33:48 devstack cinder-volume[93935]: DEBUG oslo_service.backend._eventlet.service [None req-016a76ef-1a34-4159-a9a8-732ae834def6 None None] ******************************************************************************** {{(pid=93935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:48 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:48 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:48 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.255s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:48 devstack cinder-volume[94234]: INFO cinder.volume.driver [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Driver hasn't implemented _init_vendor_properties() Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.driver [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.341567993164, 'free_capacity_gb': 1775.341567993164, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94234) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_db.sqlalchemy.engines [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writer thread running {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.db.api [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Building query based on filter {{(pid=94234) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94234) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:48 devstack cinder-volume[94234]: INFO cinder.keymgr.migration [None req-74404cc0-3e84-4e0a-aaaa-cfa5391cd825 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 20 06:33:48 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:48 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:48 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.226s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:48 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:33:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Driver initialization completed successfully. Aug 20 06:33:48 devstack cinder-volume[94234]: INFO cinder.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Initiating service 3 cleanup Aug 20 06:33:49 devstack cinder-volume[94234]: INFO cinder.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Service 3 cleanup completed. Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG cinder.service [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Creating RPC server for service cinder-volume {{(pid=94234) start /opt/stack/cinder/cinder/service.py:231}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG cinder.service [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94234) start /opt/stack/cinder/cinder/service.py:237}} Aug 20 06:33:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:33:49 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:33:49 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:33:49 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Aug 20 06:33:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.224s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:33:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef55f24b-52b6-4b13-9349-35bb988ec0fd None None] Driver post RPC initialization completed successfully. Aug 20 06:33:57 devstack cinder-volume[93935]: DEBUG dbcounter [-] [93935] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93935) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:33:59 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:33:59 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:34:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:34:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 6 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:34:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Flow 'volume_create_manager' (2f731be2-9c98-4d19-ad42-bc0ccc8d9a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f42bbff-1bae-4992-acd8-3409de2c8286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f42bbff-1bae-4992-acd8-3409de2c8286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-668623714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c735f1-02e3-49f7-8f0b-361e51b1ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7057612e132248b797a2ab6b0ba07356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:06Z,use_quota=True,user_id='965ec4f355394c18bedb4deafe45e898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95452ee9-1c3a-4b53-a0e7-fbe216fcddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95452ee9-1c3a-4b53-a0e7-fbe216fcddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7bfdd8-68a3-42d6-9acd-cb5a23a71cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7bfdd8-68a3-42d6-9acd-cb5a23a71cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c735f1-02e3-49f7-8f0b-361e51b1ff6a', 'volume_name': 'volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafe842f-e800-4716-b760-ea4a10c3317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafe842f-e800-4716-b760-ea4a10c3317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba584bb-1ef7-456f-8095-784f89b4577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:06 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Volume 38c735f1-02e3-49f7-8f0b-361e51b1ff6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a', 'volume_size': 1} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-668623714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c735f1-02e3-49f7-8f0b-361e51b1ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7057612e132248b797a2ab6b0ba07356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:06Z,use_quota=True,user_id='965ec4f355394c18bedb4deafe45e898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Creating volume 38c735f1-02e3-49f7-8f0b-361e51b1ff6a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:35:06 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:35:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:06 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a 1073741824 Aug 20 06:35:06 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:07 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a 1073741824" returned: 0 in 1.531s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:08 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a Aug 20 06:35:08 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:08 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" returned: 0 in 0.502s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba584bb-1ef7-456f-8095-784f89b4577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a572b314-8b52-44c9-9dc4-fe2c9770c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Volume volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a (38c735f1-02e3-49f7-8f0b-361e51b1ff6a): created successfully Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a572b314-8b52-44c9-9dc4-fe2c9770c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Flow 'volume_create_manager' (2f731be2-9c98-4d19-ad42-bc0ccc8d9a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e65f2794-3008-403f-bb41-74871cbfb080 tempest-DeleteServersTestJSON-318249204 None] Created volume successfully. Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Flow 'volume_create_manager' (85b9b7a0-bd0b-4c56-9778-87a734962382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f72ba0-b468-4d1b-abeb-6b7ce19db4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f72ba0-b468-4d1b-abeb-6b7ce19db4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1210367140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf8654c94994cf49a7d78e36d03a035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:11Z,use_quota=True,user_id='82c09acb5f664a3fa333b714cb245322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6b334d-5d5b-4915-b01c-b082a9f5938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6b334d-5d5b-4915-b01c-b082a9f5938c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3de19c-a6a8-47e1-87fe-790c8c04de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3de19c-a6a8-47e1-87fe-790c8c04de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94', 'volume_name': 'volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99570a0d-43b6-4f2a-aeda-17ffb88c500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99570a0d-43b6-4f2a-aeda-17ffb88c500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56093c2-5e70-49c5-8d36-1324bba1dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Volume f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94', 'volume_size': 1} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1210367140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf8654c94994cf49a7d78e36d03a035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:11Z,use_quota=True,user_id='82c09acb5f664a3fa333b714cb245322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Creating volume f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:35:10 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:35:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:11 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 1073741824 Aug 20 06:35:11 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:11 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 1073741824" returned: 0 in 0.783s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:11 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 Aug 20 06:35:11 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:12 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56093c2-5e70-49c5-8d36-1324bba1dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b763064a-a73c-495f-b0fe-f7827f40da3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:12 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Volume volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 (f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94): created successfully Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b763064a-a73c-495f-b0fe-f7827f40da3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Flow 'volume_create_manager' (85b9b7a0-bd0b-4c56-9778-87a734962382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fbf7cf3f-95e0-43a3-bc23-458a8bc598d1 tempest-VolumesAdminNegativeTest-213994362 None] Created volume successfully. Aug 20 06:35:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Acquiring lock "cinder-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:35:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "cinder-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:35:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Acquiring lock "cinder-quobyte-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:35:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "cinder-quobyte-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" acquired by "delete_volume" :: waited 0.062s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:35:13 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvfpul7yr/privsep.sock'] Aug 20 06:35:13 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvfpul7yr/privsep.sock Aug 20 06:35:13 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:15 devstack cinder-volume[94234]: WARNING py.warnings [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 20 06:35:15 devstack cinder-volume[94234]: .first() Aug 20 06:35:15 devstack cinder-volume[94234]: Aug 20 06:35:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f798ef8-5503-4839-9f02-222f68092699', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:35:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-6ebeffff-c159-43d0-8c61-a61b08ea5815 req-2161abd7-f36d-4286-9501-d1c5303cf8f3 tempest-DeleteServersTestJSON-318249204 None] attachment_update completed successfully. Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: Aug 20 06:35:16 devstack cinder-volume[94234]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 20 06:35:16 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:16 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Spawned new privsep daemon via rootwrap Aug 20 06:35:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Accepted privsep connection to /tmp/tmpvfpul7yr/privsep.sock {{(pid=94234) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 20 06:35:16 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 20 06:35:16 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 20 06:35:16 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 20 06:35:16 devstack cinder-volume[94234]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95471 Aug 20 06:35:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c442ae-7d9a-4da5-a5b4-1c2628d22fc6]: (2,) {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:35:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8a99c-0ff0-4922-a898-3498f923b1c1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:35:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:17 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 Aug 20 06:35:17 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:17 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" returned: 0 in 0.816s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:17 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94 Aug 20 06:35:17 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:18 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" returned: 0 in 0.519s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "cinder-quobyte-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94" released by "delete_volume" :: held 4.227s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:35:18 devstack cinder-volume[94234]: WARNING cinder.quota [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:35:18 devstack cinder-volume[94234]: WARNING cinder.quota [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Created reservations ['55d29c2a-a0a1-4538-bb20-f672f55ce00f', 'ca1633bf-0e5a-4ccc-a2a0-e21a087ecaf9', '648b5e49-4e69-46cf-93a3-afdceee59401', '1ca3aa49-4569-4b4f-97e5-a20413806f40'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:18 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:35:18 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:19 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.517s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:19 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:35:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Deleted volume successfully. Aug 20 06:35:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ab6d37a5-22da-45e6-9d2b-5ba4db264efa tempest-VolumesAdminNegativeTest-213994362 None] Lock "cinder-f72b7f11-f8ba-4ee5-a4a9-b3b76f5dbb94-delete_volume" released by "delete_volume" :: held 5.338s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:35:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-14c3dd08-4690-4e9e-9cfa-ea17ea0b47f6 req-0d80c033-85b4-4d6f-80f2-ed0df1dabd54 tempest-DeleteServersTestJSON-318249204 None] Terminate volume connection completed successfully. Aug 20 06:35:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-14c3dd08-4690-4e9e-9cfa-ea17ea0b47f6 req-0d80c033-85b4-4d6f-80f2-ed0df1dabd54 tempest-DeleteServersTestJSON-318249204 None] Deleting attachment 3f798ef8-5503-4839-9f02-222f68092699. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "cinder-38c735f1-02e3-49f7-8f0b-361e51b1ff6a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "cinder-38c735f1-02e3-49f7-8f0b-361e51b1ff6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "cinder-quobyte-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "cinder-quobyte-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c9a10-402a-4764-bde8-c957ce9613c6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:35:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:23 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a Aug 20 06:35:23 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:24 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:24 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a Aug 20 06:35:24 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:24 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" returned: 0 in 0.272s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "cinder-quobyte-38c735f1-02e3-49f7-8f0b-361e51b1ff6a" released by "delete_volume" :: held 0.786s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Created reservations ['18c77dcc-2f45-4b9a-ad98-59085833d887', '5be22820-8d54-46e6-91fa-f5a497fcd31c', '7a9e323d-057c-4cf9-bdac-64a923ad1825', 'b7f474c6-9aa8-472a-8eac-900aecb07bdd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:24 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:35:24 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:24 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.279s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:35:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Deleted volume successfully. Aug 20 06:35:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f436adf5-d5cf-406d-928f-f8e00198acb9 tempest-DeleteServersTestJSON-318249204 None] Lock "cinder-38c735f1-02e3-49f7-8f0b-361e51b1ff6a-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Flow 'volume_create_manager' (4fe47395-f710-4019-aad2-fed46750b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab01328-95f7-4541-9133-cfb503e46e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab01328-95f7-4541-9133-cfb503e46e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-562156618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ef327c47a94b28924e0915d8fd3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:31Z,use_quota=True,user_id='cf120b419e4049f38758785d329e1824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a016b329-642f-42e8-a168-c5cb0e022009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a016b329-642f-42e8-a168-c5cb0e022009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697c3e42-1123-4228-a538-0cba11a0375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697c3e42-1123-4228-a538-0cba11a0375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'volume_name': 'volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f9e90b-1674-4f11-9bdb-f9e4cd56c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f9e90b-1674-4f11-9bdb-f9e4cd56c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b1730e-e8c0-4fe9-9afe-f42cc559874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Volume 04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'volume_size': 1} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-562156618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ef327c47a94b28924e0915d8fd3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:35:31Z,use_quota=True,user_id='cf120b419e4049f38758785d329e1824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Creating volume 04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:35:31 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:31 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa 1073741824 Aug 20 06:35:31 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:31 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa 1073741824" returned: 0 in 0.697s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:31 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa Aug 20 06:35:31 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:32 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b1730e-e8c0-4fe9-9afe-f42cc559874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839bdfc5-4435-4a4d-835f-24cbfe907c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:35:32 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Volume volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa (04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa): created successfully Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839bdfc5-4435-4a4d-835f-24cbfe907c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:35:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Flow 'volume_create_manager' (4fe47395-f710-4019-aad2-fed46750b257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:35:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-77e2aa65-7485-4a46-9d4d-e276f851bbdd tempest-ServerActionsTestOtherA-1452494096 None] Created volume successfully. Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:35:34 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:35:34 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:35:34 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 8 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:35:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:35:42 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=25,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:35:42 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:35:59 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Flow 'volume_create_manager' (f4327de4-a2cb-4a5f-9433-aa8d842f2437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e6ca19-11b5-477b-87c5-556b74d924d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e6ca19-11b5-477b-87c5-556b74d924d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-622782204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65466436-845e-405e-9c59-c7867efd9d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1762b39dfa33459b97dcd6247e164bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:36:04Z,use_quota=True,user_id='7c750fdd79fb486e8f52d2f37387d199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f24a77-e498-4504-921d-a875d9a2e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f24a77-e498-4504-921d-a875d9a2e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913cbef6-8269-441c-8648-5b0cfa3c2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913cbef6-8269-441c-8648-5b0cfa3c2a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65466436-845e-405e-9c59-c7867efd9d7a', 'volume_name': 'volume-65466436-845e-405e-9c59-c7867efd9d7a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da781ea9-f830-4430-8def-5166671e42be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da781ea9-f830-4430-8def-5166671e42be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa97ce83-7041-46ba-b9f7-30c0ddfe05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:04 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Volume 65466436-845e-405e-9c59-c7867efd9d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65466436-845e-405e-9c59-c7867efd9d7a', 'volume_size': 1} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-622782204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65466436-845e-405e-9c59-c7867efd9d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1762b39dfa33459b97dcd6247e164bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:36:04Z,use_quota=True,user_id='7c750fdd79fb486e8f52d2f37387d199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Creating volume 65466436-845e-405e-9c59-c7867efd9d7a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:36:04 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:36:04 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a 1073741824 Aug 20 06:36:04 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:36:04 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a 1073741824" returned: 0 in 0.597s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:36:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:36:04 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a Aug 20 06:36:04 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:36:05 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa97ce83-7041-46ba-b9f7-30c0ddfe05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65466436-845e-405e-9c59-c7867efd9d7a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53ea8e-46ed-43fb-b6bc-f76450038a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:05 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Volume volume-65466436-845e-405e-9c59-c7867efd9d7a (65466436-845e-405e-9c59-c7867efd9d7a): created successfully Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53ea8e-46ed-43fb-b6bc-f76450038a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Flow 'volume_create_manager' (f4327de4-a2cb-4a5f-9433-aa8d842f2437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:36:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6b57b387-27fe-4e8b-ab28-62b3be77d829 tempest-TaggedAttachmentsTest-1831942956 None] Created volume successfully. Aug 20 06:36:15 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:36:15 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:36:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8b890bca-9017-49e4-9de0-68b71f8b51e5 req-06bb5e68-7339-4bed-aedb-ebc8235e7fab tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8b890bca-9017-49e4-9de0-68b71f8b51e5 req-06bb5e68-7339-4bed-aedb-ebc8235e7fab tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8b890bca-9017-49e4-9de0-68b71f8b51e5 req-06bb5e68-7339-4bed-aedb-ebc8235e7fab tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-8b890bca-9017-49e4-9de0-68b71f8b51e5 req-06bb5e68-7339-4bed-aedb-ebc8235e7fab tempest-ServerActionsTestOtherA-1452494096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '884b1ab2-7d0e-479f-bc3a-924f099da9a3', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:36:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-8b890bca-9017-49e4-9de0-68b71f8b51e5 req-06bb5e68-7339-4bed-aedb-ebc8235e7fab tempest-ServerActionsTestOtherA-1452494096 None] attachment_update completed successfully. Aug 20 06:36:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3b383610-606c-46f1-86b5-e61d4b426cd9 tempest-ServerActionsTestOtherA-1452494096 None] Terminate volume connection completed successfully. Aug 20 06:36:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3b383610-606c-46f1-86b5-e61d4b426cd9 tempest-ServerActionsTestOtherA-1452494096 None] Deleting attachment 884b1ab2-7d0e-479f-bc3a-924f099da9a3. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.092s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:36:34 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:36:34 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:36:35 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Aug 20 06:36:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 1.165s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:36:35 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:36:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3fd33d51-51c5-4396-8966-9f9f088dfe4a tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3fd33d51-51c5-4396-8966-9f9f088dfe4a tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3fd33d51-51c5-4396-8966-9f9f088dfe4a tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3fd33d51-51c5-4396-8966-9f9f088dfe4a tempest-ServerActionsTestOtherA-1452494096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f9c9fca-4100-4ebc-85ab-8ba00324494e', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:36:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4a819126-fb9c-4629-a8a3-7d2f180f2347 req-3fd33d51-51c5-4396-8966-9f9f088dfe4a tempest-ServerActionsTestOtherA-1452494096 None] attachment_update completed successfully. Aug 20 06:36:39 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:36:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Flow 'volume_create_manager' (07884784-c1fc-498a-83a8-c1b298b8922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:36:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc83856-c8c0-490a-a916-9cbdd369b6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc83856-c8c0-490a-a916-9cbdd369b6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-909861797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5a3886-f3fb-4b72-a071-dddff6a3325f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda71c184152492f84dcf880d49e7cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:36:40Z,use_quota=True,user_id='6b4d7176b658471b9c6128971d92dce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c88600-e77f-47bc-ba2b-d2b965b44949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c88600-e77f-47bc-ba2b-d2b965b44949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb3cfde-6af3-4c68-b460-2e38636b1ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb3cfde-6af3-4c68-b460-2e38636b1ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5a3886-f3fb-4b72-a071-dddff6a3325f', 'volume_name': 'volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cb8c2-4145-48d6-99d5-1836b9b4846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cb8c2-4145-48d6-99d5-1836b9b4846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a41b998-8c10-4105-8188-4084daa7431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Volume eb5a3886-f3fb-4b72-a071-dddff6a3325f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f', 'volume_size': 1} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-909861797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5a3886-f3fb-4b72-a071-dddff6a3325f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda71c184152492f84dcf880d49e7cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:36:40Z,use_quota=True,user_id='6b4d7176b658471b9c6128971d92dce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Creating volume eb5a3886-f3fb-4b72-a071-dddff6a3325f {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:36:40 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:36:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:36:40 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f 1073741824 Aug 20 06:36:40 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:36:41 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Aug 20 06:36:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f 1073741824" returned: 0 in 1.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:36:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:36:41 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f Aug 20 06:36:41 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:36:42 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f" returned: 0 in 1.036s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] <== create_volume: return (2594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.600s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a41b998-8c10-4105-8188-4084daa7431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3302e6d-d174-4a77-a5e6-d01a22158de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:36:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Volume volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f (eb5a3886-f3fb-4b72-a071-dddff6a3325f): created successfully Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3302e6d-d174-4a77-a5e6-d01a22158de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:36:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Flow 'volume_create_manager' (07884784-c1fc-498a-83a8-c1b298b8922c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:36:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fa95fafd-2597-48c3-873e-b582d86872dd tempest-ServerRescueNegativeTestJSON-1223209293 None] Created volume successfully. Aug 20 06:36:52 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:36:52 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Acquiring lock "cinder-eb5a3886-f3fb-4b72-a071-dddff6a3325f-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "cinder-eb5a3886-f3fb-4b72-a071-dddff6a3325f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Acquiring lock "cinder-quobyte-eb5a3886-f3fb-4b72-a071-dddff6a3325f" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "cinder-quobyte-eb5a3886-f3fb-4b72-a071-dddff6a3325f" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6ba24-d06a-45a3-9b41-a08fa1c46725]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:00 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f Aug 20 06:37:00 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:00 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f" returned: 0 in 0.436s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:00 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f Aug 20 06:37:00 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:00 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb5a3886-f3fb-4b72-a071-dddff6a3325f" returned: 0 in 0.324s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "cinder-quobyte-eb5a3886-f3fb-4b72-a071-dddff6a3325f" released by "delete_volume" :: held 0.829s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Created reservations ['42f0760c-ad16-44c9-a5cb-cf17b30a8fab', 'f66f971d-8c63-4388-80a1-bf05eafdb58f', 'fab3d5b2-f5f0-4280-9c80-99d7b3990ae6', '47e3a6b1-31ed-4260-96c4-50f4adf065de'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:01 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:37:01 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:01 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.513s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:37:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Deleted volume successfully. Aug 20 06:37:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6bd8300b-d03e-4932-8774-54b02197e2bb tempest-ServerRescueNegativeTestJSON-1223209293 None] Lock "cinder-eb5a3886-f3fb-4b72-a071-dddff6a3325f-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Flow 'volume_create_manager' (7078c06b-a6d9-4bc2-af6c-ce8a57ae4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26066fc0-e9da-4619-ae5a-d84af9b9c547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26066fc0-e9da-4619-ae5a-d84af9b9c547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-648573890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6d7fc1-8f40-4c99-be0f-2ead228c907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47645c233cd94d74a4a60476be9902c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:10Z,use_quota=True,user_id='acb7a699b4de4bd08c5737faf1b29c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ac084-9da5-4dc5-9c28-e0cd3364d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ac084-9da5-4dc5-9c28-e0cd3364d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ead3f8-bf82-4f56-a1a6-9a5dbcaf90a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ead3f8-bf82-4f56-a1a6-9a5dbcaf90a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6d7fc1-8f40-4c99-be0f-2ead228c907e', 'volume_name': 'volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5c52a5-2cf3-4483-944b-ca984c7fa990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5c52a5-2cf3-4483-944b-ca984c7fa990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04fb37f-d66d-461e-b085-87cb5119068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Volume ab6d7fc1-8f40-4c99-be0f-2ead228c907e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e', 'volume_size': 1} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-648573890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6d7fc1-8f40-4c99-be0f-2ead228c907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47645c233cd94d74a4a60476be9902c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:10Z,use_quota=True,user_id='acb7a699b4de4bd08c5737faf1b29c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Creating volume ab6d7fc1-8f40-4c99-be0f-2ead228c907e {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:37:10 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:10 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e 1073741824 Aug 20 06:37:10 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:10 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e 1073741824" returned: 0 in 0.660s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:10 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e Aug 20 06:37:10 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:11 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" returned: 0 in 0.259s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04fb37f-d66d-461e-b085-87cb5119068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68b5d63-1c9d-4788-a5d0-5db055fd0bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:11 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Volume volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e (ab6d7fc1-8f40-4c99-be0f-2ead228c907e): created successfully Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68b5d63-1c9d-4788-a5d0-5db055fd0bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Flow 'volume_create_manager' (7078c06b-a6d9-4bc2-af6c-ce8a57ae4529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e6291ea8-9acb-430e-ba35-1650f20dc1c8 tempest-AttachVolumeShelveTestJSON-1191563944 None] Created volume successfully. Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-39896300-2681-4959-b0b7-7a07c7d18239 req-6f261930-0d9f-4a10-bd8b-ef79ee7d423e tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-39896300-2681-4959-b0b7-7a07c7d18239 req-6f261930-0d9f-4a10-bd8b-ef79ee7d423e tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-39896300-2681-4959-b0b7-7a07c7d18239 req-6f261930-0d9f-4a10-bd8b-ef79ee7d423e tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-39896300-2681-4959-b0b7-7a07c7d18239 req-6f261930-0d9f-4a10-bd8b-ef79ee7d423e tempest-TaggedAttachmentsTest-1831942956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-65466436-845e-405e-9c59-c7867efd9d7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f53ccde2-599f-4b33-86f4-f047a54a149b', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:37:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-39896300-2681-4959-b0b7-7a07c7d18239 req-6f261930-0d9f-4a10-bd8b-ef79ee7d423e tempest-TaggedAttachmentsTest-1831942956 None] attachment_update completed successfully. Aug 20 06:37:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4ff6d371-2ef0-43e1-ac24-ae54e55d8423 req-d9341444-04f3-40c5-b2bb-44f0f7c16f40 tempest-TaggedAttachmentsTest-1831942956 None] Terminate volume connection completed successfully. Aug 20 06:37:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4ff6d371-2ef0-43e1-ac24-ae54e55d8423 req-d9341444-04f3-40c5-b2bb-44f0f7c16f40 tempest-TaggedAttachmentsTest-1831942956 None] Deleting attachment f53ccde2-599f-4b33-86f4-f047a54a149b. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:37:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-2cada9c9-24f5-4c48-8db4-a98316812839 req-61494a86-3bae-45ad-a4f0-90498333957c tempest-AttachVolumeShelveTestJSON-1191563944 None] No connector for attachment 78b4ff5a-f3d8-4dbd-b8a1-afbac217ab2a; skipping storage backend terminate_connection call. {{(pid=94234) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 20 06:37:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-2cada9c9-24f5-4c48-8db4-a98316812839 req-61494a86-3bae-45ad-a4f0-90498333957c tempest-AttachVolumeShelveTestJSON-1191563944 None] Deleting attachment 78b4ff5a-f3d8-4dbd-b8a1-afbac217ab2a. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "cinder-65466436-845e-405e-9c59-c7867efd9d7a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "cinder-65466436-845e-405e-9c59-c7867efd9d7a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "cinder-quobyte-65466436-845e-405e-9c59-c7867efd9d7a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "cinder-quobyte-65466436-845e-405e-9c59-c7867efd9d7a" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60fda7-ae24-44ff-b9de-ce1ef3bd6f4d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:28 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a Aug 20 06:37:28 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:28 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:28 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a Aug 20 06:37:28 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:29 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65466436-845e-405e-9c59-c7867efd9d7a" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "cinder-quobyte-65466436-845e-405e-9c59-c7867efd9d7a" released by "delete_volume" :: held 0.943s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Created reservations ['c977682d-da3d-4a6d-81f6-9c892d4110f0', '36b3c8b0-b242-4315-9ceb-2733dfa31b2b', 'fec4a3cb-d88a-463b-9c30-a041aa7bd208', 'c60daa84-5e42-4d9a-98c4-8acc105c07f6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:29 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:37:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4840aff9-f73f-43eb-be7e-942db10b6b4e req-03bffd25-0c5e-4cd1-9bcd-738d064be8d3 tempest-ServerActionsTestOtherA-1452494096 None] Terminate volume connection completed successfully. Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4840aff9-f73f-43eb-be7e-942db10b6b4e req-03bffd25-0c5e-4cd1-9bcd-738d064be8d3 tempest-ServerActionsTestOtherA-1452494096 None] Deleting attachment 7f9c9fca-4100-4ebc-85ab-8ba00324494e. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:37:29 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:29 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.450s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:37:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Deleted volume successfully. Aug 20 06:37:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-218231ef-9db9-4f0e-a8ab-7ef5e4c8bcd5 tempest-TaggedAttachmentsTest-1831942956 None] Lock "cinder-65466436-845e-405e-9c59-c7867efd9d7a-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:34 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:37:34 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:34 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.382s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 8 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:37:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Flow 'volume_create_manager' (1eee00c5-ad31-4384-9355-ec02460ed280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4c685-aaec-4461-bdd0-925a918ef0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4c685-aaec-4461-bdd0-925a918ef0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1489737015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa57dc-8159-4704-9ab6-531cd5f64c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ef327c47a94b28924e0915d8fd3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:39Z,use_quota=True,user_id='cf120b419e4049f38758785d329e1824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af919f8-eea9-4c43-b6f6-c985862030cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af919f8-eea9-4c43-b6f6-c985862030cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12361257-2c3b-466a-918b-cfa94bd53f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:39 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:37:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-44d6842a-e11b-4f5d-876f-09762658196f tempest-GroupsTest-1321530022 None] Group tempest-Group1-748018818: creating Aug 20 06:37:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-44d6842a-e11b-4f5d-876f-09762658196f tempest-GroupsTest-1321530022 None] Group tempest-Group1-748018818: created successfully Aug 20 06:37:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-44d6842a-e11b-4f5d-876f-09762658196f tempest-GroupsTest-1321530022 None] Create group completed successfully. Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12361257-2c3b-466a-918b-cfa94bd53f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87aa57dc-8159-4704-9ab6-531cd5f64c70', 'volume_name': 'volume-87aa57dc-8159-4704-9ab6-531cd5f64c70', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60094812-8b3b-4a32-83e6-2b763450c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60094812-8b3b-4a32-83e6-2b763450c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86976395-bcb5-4192-8861-81855e5f10a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Volume 87aa57dc-8159-4704-9ab6-531cd5f64c70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87aa57dc-8159-4704-9ab6-531cd5f64c70', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Trying to clone 87aa57dc-8159-4704-9ab6-531cd5f64c70 from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:37:40 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:37:40 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Image download 20.69 MB at 20.69 MB/s Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbac821-2037-4c24-aac9-dd7fdf8d0a4e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:41 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD Aug 20 06:37:41 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1bc9e10e-2d71-4bfe-9cd3-ccecc6bbd2d5 tempest-GroupsTest-1321530022 None] Group tempest-Group2-1654138742: creating Aug 20 06:37:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1bc9e10e-2d71-4bfe-9cd3-ccecc6bbd2d5 tempest-GroupsTest-1321530022 None] Group tempest-Group2-1654138742: created successfully Aug 20 06:37:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1bc9e10e-2d71-4bfe-9cd3-ccecc6bbd2d5 tempest-GroupsTest-1321530022 None] Create group completed successfully. Aug 20 06:37:41 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 is fetched for user cf120b419e4049f38758785d329e1824. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626f3bb-d65b-461f-be2a-ca1e24c37011]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:42 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD Aug 20 06:37:42 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:42 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1489737015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa57dc-8159-4704-9ab6-531cd5f64c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ef327c47a94b28924e0915d8fd3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:39Z,use_quota=True,user_id='cf120b419e4049f38758785d329e1824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Creating volume 87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:37:42 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:37:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:42 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1073741824 Aug 20 06:37:42 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:43 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1073741824" returned: 0 in 0.876s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:37:43 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 Aug 20 06:37:43 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (5dfb6195-db10-42c5-93fd-7d46cc41bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc7298e-039b-42b2-bbc1-43a860a011e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc7298e-039b-42b2-bbc1-43a860a011e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1713771371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d28ef12-7ac4-48f6-a6ff-0ab6dc99b1ed,host='devstack@QuobyteHD#QuobyteHD',id=a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:43Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9682c021-e757-4d79-922c-cecc22f431ba),volume_type_id=9682c021-e757-4d79-922c-cecc22f431ba)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b9ae4a-4dee-4d54-b1bb-bae5f974f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b9ae4a-4dee-4d54-b1bb-bae5f974f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668f43e6-3286-4d1d-8a77-27b4f66021ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668f43e6-3286-4d1d-8a77-27b4f66021ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3', 'volume_name': 'volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d86d47f-06cc-4678-a549-3ebb0cf1cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d86d47f-06cc-4678-a549-3ebb0cf1cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe69c50-aeca-485d-972b-8e497fddf797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Volume a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3', 'volume_size': 1} Aug 20 06:37:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:44 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70" returned: 0 in 0.623s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d28ef12-7ac4-48f6-a6ff-0ab6dc99b1ed,created_at=2026-08-20T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1713771371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d28ef12-7ac4-48f6-a6ff-0ab6dc99b1ed,host='devstack@QuobyteHD#QuobyteHD',id=a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:43Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9682c021-e757-4d79-922c-cecc22f431ba),volume_type_id=9682c021-e757-4d79-922c-cecc22f431ba)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Creating volume a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:37:44 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:44 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 1073741824 Aug 20 06:37:44 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Attempting download of d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 87aa57dc-8159-4704-9ab6-531cd5f64c70. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fcbe2f-e737-4f17-83ae-9ac60b416393]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:44 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d Aug 20 06:37:44 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:44 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d" returned: 0 in 0.680s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:45 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 1073741824" returned: 0 in 1.004s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:45 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d Aug 20 06:37:45 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:45 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 Aug 20 06:37:45 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:45 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d" returned: 1 in 0.660s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_gbdf3s3d' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[132bc5f4-048a-4528-a1d9-9ea7472d7703]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:45 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" returned: 0 in 0.454s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe69c50-aeca-485d-972b-8e497fddf797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346dc74-a76b-464e-863f-eb09ace8eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Volume volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 (a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3): created successfully Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346dc74-a76b-464e-863f-eb09ace8eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (5dfb6195-db10-42c5-93fd-7d46cc41bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-492c4a1b-c638-4285-909a-1c2b8bd4e8ab tempest-GroupsTest-1321530022 None] Created volume successfully. Aug 20 06:37:45 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD Aug 20 06:37:45 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:46 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD" returned: 0 in 0.507s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:37:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:46 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 Aug 20 06:37:46 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Acquiring lock "cinder-quobyte-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd9ae2-8ad1-431f-ad5f-731313099813]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:47 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 Aug 20 06:37:47 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:47 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:47 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3 Aug 20 06:37:47 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:48 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" returned: 0 in 0.313s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-a32a2d56-6c2a-41a2-af9c-f0d3ecb721c3" released by "delete_volume" :: held 0.872s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:37:48 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70" returned: 0 in 2.136s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_62mwzld3devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:37:48 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Converted 112.00 MB image at 52.28 MB/s Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:48 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1G Aug 20 06:37:48 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Created reservations ['b873c1d7-b32c-4341-aeb3-e08ad9480c89'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:37:48 devstack cinder-volume[94234]: WARNING cinder.quota [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2002884971 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2002884971, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:37:48 devstack cinder-volume[94234]: WARNING cinder.quota [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2002884971 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2002884971, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Created reservations ['16174b75-35ac-4dd4-b109-80c951d63758', 'caada5b7-e852-481e-b58e-0c4c0024fb06', '7a4f81eb-215d-4e71-930b-ba370effadf9', 'fe864f0b-c8f9-4442-af67-e39bef1d8f05'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:37:48 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 1G" returned: 0 in 0.432s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Downloaded image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 87aa57dc-8159-4704-9ab6-531cd5f64c70 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 for user cf120b419e4049f38758785d329e1824 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Marking volume 87aa57dc-8159-4704-9ab6-531cd5f64c70 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Copying metadata from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 to 87aa57dc-8159-4704-9ab6-531cd5f64c70. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Creating volume glance metadata for volume 87aa57dc-8159-4704-9ab6-531cd5f64c70 backed by image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:37:48 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:37:48 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86976395-bcb5-4192-8861-81855e5f10a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87aa57dc-8159-4704-9ab6-531cd5f64c70', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf4742d-8f8c-42d0-8647-a5747f3d33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Volume volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 (87aa57dc-8159-4704-9ab6-531cd5f64c70): created successfully Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf4742d-8f8c-42d0-8647-a5747f3d33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Flow 'volume_create_manager' (1eee00c5-ad31-4384-9355-ec02460ed280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9330ee74-805e-4cf2-a9b6-5b8b910333f7 tempest-ServerActionsTestOtherA-1452494096 None] Created volume successfully. Aug 20 06:37:49 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.340s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:49 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:37:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2be5f208-13f3-4275-a805-dd2fd8ae7a93 tempest-GroupsTest-1321530022 None] Delete group completed successfully. Aug 20 06:37:49 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Created reservations ['a1680cbb-cfe2-45a7-8c62-09d06c090bee'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:50 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:37:50 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:50 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.291s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:50 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:37:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a941d2dc-465d-4110-8ff5-aea6837cbb21 tempest-GroupsTest-1321530022 None] Delete group completed successfully. Aug 20 06:37:51 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1640e794-b133-4ac1-84bd-981f2ce69353 tempest-GroupsTest-1321530022 None] Group tempest-GroupsTest-Group-1454405172: creating Aug 20 06:37:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1640e794-b133-4ac1-84bd-981f2ce69353 tempest-GroupsTest-1321530022 None] Group tempest-GroupsTest-Group-1454405172: created successfully Aug 20 06:37:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1640e794-b133-4ac1-84bd-981f2ce69353 tempest-GroupsTest-1321530022 None] Create group completed successfully. Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=45,cinder:SELECT=51,cinder:INSERT=13,cinder:DELETE=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-b865afa8-0eaa-4e93-af91-5bf41b516561 req-eba8dbc6-9d7a-4427-a6ab-409a1db216b6 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-b865afa8-0eaa-4e93-af91-5bf41b516561 req-eba8dbc6-9d7a-4427-a6ab-409a1db216b6 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-b865afa8-0eaa-4e93-af91-5bf41b516561 req-eba8dbc6-9d7a-4427-a6ab-409a1db216b6 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-b865afa8-0eaa-4e93-af91-5bf41b516561 req-eba8dbc6-9d7a-4427-a6ab-409a1db216b6 tempest-ServerActionsTestOtherA-1452494096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-87aa57dc-8159-4704-9ab6-531cd5f64c70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fe7b55b-1e37-4945-ae62-a922bbc943e8', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:37:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-b865afa8-0eaa-4e93-af91-5bf41b516561 req-eba8dbc6-9d7a-4427-a6ab-409a1db216b6 tempest-ServerActionsTestOtherA-1452494096 None] attachment_update completed successfully. Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (ad50ec21-27ce-46a6-a2fe-af691007b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7930f31f-8b7e-49e5-8c86-2920419822dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7930f31f-8b7e-49e5-8c86-2920419822dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317661319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,host='devstack@QuobyteHD#QuobyteHD',id=62aa4c81-c49d-4b3e-995e-5e3f575d394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:54Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f813edc8-a2fb-437d-9834-758f2ea468be),volume_type_id=f813edc8-a2fb-437d-9834-758f2ea468be)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0476b883-2747-491c-a22a-7120af6ddb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0476b883-2747-491c-a22a-7120af6ddb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1b81cc-7a6c-4731-823a-b50e0f098c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1b81cc-7a6c-4731-823a-b50e0f098c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62aa4c81-c49d-4b3e-995e-5e3f575d394d', 'volume_name': 'volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425762e-3a17-445d-af5c-f1fa755107b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425762e-3a17-445d-af5c-f1fa755107b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bb7b22-f38e-4d40-9771-6583db91d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Volume 62aa4c81-c49d-4b3e-995e-5e3f575d394d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d', 'volume_size': 1} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,created_at=2026-08-20T04:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317661319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,host='devstack@QuobyteHD#QuobyteHD',id=62aa4c81-c49d-4b3e-995e-5e3f575d394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:54Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f813edc8-a2fb-437d-9834-758f2ea468be),volume_type_id=f813edc8-a2fb-437d-9834-758f2ea468be)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Creating volume 62aa4c81-c49d-4b3e-995e-5e3f575d394d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:37:54 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:37:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:54 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d 1073741824 Aug 20 06:37:54 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:55 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d 1073741824" returned: 0 in 0.598s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:55 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d Aug 20 06:37:55 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:55 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d" returned: 0 in 0.486s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bb7b22-f38e-4d40-9771-6583db91d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b869278-a6d8-4cba-8a28-2e9fab474f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Volume volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d (62aa4c81-c49d-4b3e-995e-5e3f575d394d): created successfully Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b869278-a6d8-4cba-8a28-2e9fab474f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (ad50ec21-27ce-46a6-a2fe-af691007b242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-76479ae4-5c5d-4620-8baf-cdd8d82dbad9 tempest-GroupsTest-1321530022 None] Created volume successfully. Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (40a864c9-924c-4855-bcd2-953a0d3453ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6797e7be-5e6e-4ee9-a25a-8544269d3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6797e7be-5e6e-4ee9-a25a-8544269d3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-834417442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,host='devstack@QuobyteHD#QuobyteHD',id=f4c92e9a-48df-4d26-a13a-808b1d541cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:58Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f813edc8-a2fb-437d-9834-758f2ea468be),volume_type_id=f813edc8-a2fb-437d-9834-758f2ea468be)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7c7e67-5b88-49fb-89e7-40a8b98ea0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7c7e67-5b88-49fb-89e7-40a8b98ea0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea1100a-1fec-49b3-901b-38d4ecf94c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea1100a-1fec-49b3-901b-38d4ecf94c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c92e9a-48df-4d26-a13a-808b1d541cd7', 'volume_name': 'volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5e200b-a3a5-4a0c-a6bb-908e5336464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5e200b-a3a5-4a0c-a6bb-908e5336464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971dd196-f04e-4398-a577-acf8b7a2349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:58 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Volume f4c92e9a-48df-4d26-a13a-808b1d541cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7', 'volume_size': 1} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,created_at=2026-08-20T04:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-834417442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b0f9390-4514-4eb4-adc2-050b5e3e0878,host='devstack@QuobyteHD#QuobyteHD',id=f4c92e9a-48df-4d26-a13a-808b1d541cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb285235ff54578a9a2d0db05607bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:37:58Z,use_quota=True,user_id='f56fbb1f19194c77bd224375e152cf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f813edc8-a2fb-437d-9834-758f2ea468be),volume_type_id=f813edc8-a2fb-437d-9834-758f2ea468be)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Creating volume f4c92e9a-48df-4d26-a13a-808b1d541cd7 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:37:58 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:37:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:58 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 1073741824 Aug 20 06:37:58 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:59 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 1073741824" returned: 0 in 0.812s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:37:59 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 Aug 20 06:37:59 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:37:59 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7" returned: 0 in 0.504s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971dd196-f04e-4398-a577-acf8b7a2349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76387ee-b344-4fec-a426-d1991bee448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:37:59 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Volume volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 (f4c92e9a-48df-4d26-a13a-808b1d541cd7): created successfully Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76387ee-b344-4fec-a426-d1991bee448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:37:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Flow 'volume_create_manager' (40a864c9-924c-4855-bcd2-953a0d3453ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:37:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2f5a7a14-0d1f-4e04-8e26-5c5606f3f1c7 tempest-GroupsTest-1321530022 None] Created volume successfully. Aug 20 06:38:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-46916d03-2806-41c6-8300-74517acb2349 tempest-GroupsTest-1321530022 None] Update group completed successfully. Aug 20 06:38:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a3ed9d40-57cb-47aa-8f83-c654b23ba0da tempest-GroupsTest-1321530022 None] Update group completed successfully. Aug 20 06:38:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Acquiring lock "cinder-quobyte-62aa4c81-c49d-4b3e-995e-5e3f575d394d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-62aa4c81-c49d-4b3e-995e-5e3f575d394d" acquired by "delete_volume" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e2611-77fe-4f73-a11e-73711bf91065]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:05 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d Aug 20 06:38:05 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:05 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d" returned: 0 in 0.516s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:05 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d Aug 20 06:38:05 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:05 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62aa4c81-c49d-4b3e-995e-5e3f575d394d" returned: 0 in 0.422s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-62aa4c81-c49d-4b3e-995e-5e3f575d394d" released by "delete_volume" :: held 1.028s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Acquiring lock "cinder-quobyte-f4c92e9a-48df-4d26-a13a-808b1d541cd7" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-f4c92e9a-48df-4d26-a13a-808b1d541cd7" acquired by "delete_volume" :: waited 0.038s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:06 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7183cc-eacf-4c85-a47b-04c6905c5457]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:06 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 Aug 20 06:38:06 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:07 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7" returned: 0 in 1.114s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:07 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7 Aug 20 06:38:07 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:07 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4c92e9a-48df-4d26-a13a-808b1d541cd7" returned: 0 in 0.758s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "cinder-quobyte-f4c92e9a-48df-4d26-a13a-808b1d541cd7" released by "delete_volume" :: held 2.004s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Created reservations ['2b40921c-4e81-492a-93e7-ae3900238dd9'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:08 devstack cinder-volume[94234]: WARNING cinder.quota [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-865391838 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-865391838, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:38:08 devstack cinder-volume[94234]: WARNING cinder.quota [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-865391838 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-865391838, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Created reservations ['eb1fcff1-5dc9-47ee-b26f-d60a0974ba6b', '33b61b02-d6a9-4dce-a98a-7f6c08d4e7f9', 'eaca088e-b34d-493b-b4db-8d9446dcf26a', 'ae9a55c2-5573-4667-9212-1a97258987eb'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Created reservations ['cf26d597-36c8-4de1-b87c-ab154c86a4a6', '42dd9559-a247-4ef9-8457-eedc6e00ad33', '7f75e8e7-f064-4a7e-8344-b8d0fcec4924', '4ae47761-08fa-48a3-a2ec-ef38727b1e09'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:08 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:08 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:09 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.567s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:09 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-57abf127-2cd5-488f-8b19-d66817cbb14f tempest-GroupsTest-1321530022 None] Delete group completed successfully. Aug 20 06:38:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-a22fbece-730c-4046-a18b-95406d1e5ba2 tempest-ServerActionsTestOtherA-1452494096 None] Terminate volume connection completed successfully. Aug 20 06:38:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-a22fbece-730c-4046-a18b-95406d1e5ba2 tempest-ServerActionsTestOtherA-1452494096 None] Deleting attachment 1fe7b55b-1e37-4945-ae62-a922bbc943e8. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:38:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-775e92e0-83ba-428d-ad36-62db9abd27ec tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-775e92e0-83ba-428d-ad36-62db9abd27ec tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-775e92e0-83ba-428d-ad36-62db9abd27ec tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-775e92e0-83ba-428d-ad36-62db9abd27ec tempest-ServerActionsTestOtherA-1452494096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-87aa57dc-8159-4704-9ab6-531cd5f64c70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6d5e7fa-cf19-4a0b-8d98-ef1c0f722798', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:38:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-0c031331-00b4-4380-885c-1c07de32d1c5 req-775e92e0-83ba-428d-ad36-62db9abd27ec tempest-ServerActionsTestOtherA-1452494096 None] attachment_update completed successfully. Aug 20 06:38:29 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=34,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:38:29 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=27,cinder:SELECT=34,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:38:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Acquiring lock "cinder-ab6d7fc1-8f40-4c99-be0f-2ead228c907e-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "cinder-ab6d7fc1-8f40-4c99-be0f-2ead228c907e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Acquiring lock "cinder-quobyte-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "cinder-quobyte-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a69986-f443-49b8-a15d-b19024c4f9c0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:34 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e Aug 20 06:38:34 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:34 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:34 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:34 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" returned: 0 in 0.980s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:35 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e Aug 20 06:38:35 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:35 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.826s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Flow 'volume_create_manager' (cbef61ec-19d3-463f-961c-0f9a261bf122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4defebe7-b368-4d60-899e-06327532d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4defebe7-b368-4d60-899e-06327532d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-791818015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44189b26-6e45-4c90-b17b-290e8f114296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1516da9c4e6c4ee5aaf785897817d89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:35Z,use_quota=True,user_id='34265f00180a46858dd953a3bbd0a9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb042c4c-c3fa-4259-b440-7af90d98e108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb042c4c-c3fa-4259-b440-7af90d98e108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bed26de-e912-4d3d-bef8-7db112c5ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bed26de-e912-4d3d-bef8-7db112c5ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44189b26-6e45-4c90-b17b-290e8f114296', 'volume_name': 'volume-44189b26-6e45-4c90-b17b-290e8f114296', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963de78b-d37c-4ff8-a4ee-54a5c281f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963de78b-d37c-4ff8-a4ee-54a5c281f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e2a3ab-3c70-4cbb-9216-0ff322c254c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:35 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Volume 44189b26-6e45-4c90-b17b-290e8f114296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44189b26-6e45-4c90-b17b-290e8f114296', 'volume_size': 1} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-791818015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44189b26-6e45-4c90-b17b-290e8f114296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1516da9c4e6c4ee5aaf785897817d89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:35Z,use_quota=True,user_id='34265f00180a46858dd953a3bbd0a9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Creating volume 44189b26-6e45-4c90-b17b-290e8f114296 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:35 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:38:35 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" returned: 0 in 0.589s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "cinder-quobyte-ab6d7fc1-8f40-4c99-be0f-2ead228c907e" released by "delete_volume" :: held 1.695s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:35 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 1073741824 Aug 20 06:38:35 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Created reservations ['70d40225-2dc3-4373-87b8-bd4287dc7d7f', '82dd0f2a-9275-4486-a744-6d0a75c8bf7d', '3aebe389-a8b1-4d8c-bb1b-5a679d776f63', '34ff7578-f4de-4285-841c-57819ef89a27'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:35 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:35 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:36 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.634s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Deleted volume successfully. Aug 20 06:38:36 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 1073741824" returned: 0 in 0.977s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ddf400f0-b2fa-4981-ab39-36d361314ace tempest-AttachVolumeShelveTestJSON-1191563944 None] Lock "cinder-ab6d7fc1-8f40-4c99-be0f-2ead228c907e-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:36 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 Aug 20 06:38:36 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:37 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296" returned: 0 in 0.587s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e2a3ab-3c70-4cbb-9216-0ff322c254c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44189b26-6e45-4c90-b17b-290e8f114296', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d387bf1-c2dc-4e8a-8798-0be146b688bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:37 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Volume volume-44189b26-6e45-4c90-b17b-290e8f114296 (44189b26-6e45-4c90-b17b-290e8f114296): created successfully Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d387bf1-c2dc-4e8a-8798-0be146b688bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Flow 'volume_create_manager' (cbef61ec-19d3-463f-961c-0f9a261bf122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f85d53bc-f47b-4f14-abe0-c1b1f7ece0e0 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Created volume successfully. Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Acquiring lock "cinder-44189b26-6e45-4c90-b17b-290e8f114296-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "cinder-44189b26-6e45-4c90-b17b-290e8f114296-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Acquiring lock "cinder-quobyte-44189b26-6e45-4c90-b17b-290e8f114296" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "cinder-quobyte-44189b26-6e45-4c90-b17b-290e8f114296" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03be48-4aad-4bfd-b75d-e715db3e0b0a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:41 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 Aug 20 06:38:41 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:42 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296" returned: 0 in 0.594s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:42 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296 Aug 20 06:38:42 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:42 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-44189b26-6e45-4c90-b17b-290e8f114296" returned: 0 in 0.504s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "cinder-quobyte-44189b26-6e45-4c90-b17b-290e8f114296" released by "delete_volume" :: held 1.191s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:42 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Created reservations ['fc5e42a7-3653-4a2c-b4db-c511619158de', '29a4f142-880a-4e33-8a31-8b6f18b401db', 'dcdd3936-8b89-4652-8d49-ba0fd8c3cf69', 'd98166b9-2667-4787-aeed-7307284bd9f6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:43 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:43 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:43 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.338s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Deleted volume successfully. Aug 20 06:38:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-515e4144-f6e8-43e1-94f0-c182e6b9ea08 tempest-VolumeQuotasNegativeTestJSON-1699614914 None] Lock "cinder-44189b26-6e45-4c90-b17b-290e8f114296-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Flow 'volume_create_manager' (868c06bb-b258-4607-ba97-8c48192b5efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb54b104-225e-40cc-98fa-e63269091637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb54b104-225e-40cc-98fa-e63269091637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562748587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e0fd76-f4c9-4062-983d-32eae09b8d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a6b4425fc4c57bc3091bf3113e0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:45Z,use_quota=True,user_id='4769730abb3148ab9215acde01c78f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02c2d29-488e-4293-ac04-d831e0c00091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02c2d29-488e-4293-ac04-d831e0c00091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34862c08-48c0-47a0-b5c0-a57ce0411bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34862c08-48c0-47a0-b5c0-a57ce0411bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e0fd76-f4c9-4062-983d-32eae09b8d87', 'volume_name': 'volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94e42d-66b8-4234-b41b-9e7760fccb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94e42d-66b8-4234-b41b-9e7760fccb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b674d-ac55-4b61-9f85-55ac0c71614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:44 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Volume d9e0fd76-f4c9-4062-983d-32eae09b8d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87', 'volume_size': 1} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562748587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e0fd76-f4c9-4062-983d-32eae09b8d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a6b4425fc4c57bc3091bf3113e0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:45Z,use_quota=True,user_id='4769730abb3148ab9215acde01c78f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Creating volume d9e0fd76-f4c9-4062-983d-32eae09b8d87 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:38:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:45 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 1073741824 Aug 20 06:38:45 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:45 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 1073741824" returned: 0 in 0.769s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:45 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 Aug 20 06:38:45 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:46 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87" returned: 0 in 0.354s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b674d-ac55-4b61-9f85-55ac0c71614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5123763-bdfd-42ca-9f8b-fae3a9a0759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Volume volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 (d9e0fd76-f4c9-4062-983d-32eae09b8d87): created successfully Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5123763-bdfd-42ca-9f8b-fae3a9a0759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Flow 'volume_create_manager' (868c06bb-b258-4607-ba97-8c48192b5efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5ff9025e-a9aa-4fad-9f78-d439b0195572 tempest-ServersNegativeTestJSON-1186279642 None] Created volume successfully. Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Flow 'volume_create_manager' (10e72085-557c-49ec-a06f-f2df35df71be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e49b52-0dcc-41e0-9aec-65f99d5fbcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e49b52-0dcc-41e0-9aec-65f99d5fbcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-860285899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e68f13-4f3b-48db-a8e7-3d093b78f341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a6b4425fc4c57bc3091bf3113e0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:49Z,use_quota=True,user_id='4769730abb3148ab9215acde01c78f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fb72a2-f6a9-4165-afdc-45260d593f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fb72a2-f6a9-4165-afdc-45260d593f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74c4ef8-7b06-4205-9555-d662e035afae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74c4ef8-7b06-4205-9555-d662e035afae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e68f13-4f3b-48db-a8e7-3d093b78f341', 'volume_name': 'volume-40e68f13-4f3b-48db-a8e7-3d093b78f341', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ce0541-8e35-4d80-abce-ff168975aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ce0541-8e35-4d80-abce-ff168975aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3de49d-64cc-4925-bd3b-f4e64f27f49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:49 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Volume 40e68f13-4f3b-48db-a8e7-3d093b78f341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e68f13-4f3b-48db-a8e7-3d093b78f341', 'volume_size': 1} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-860285899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e68f13-4f3b-48db-a8e7-3d093b78f341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a6b4425fc4c57bc3091bf3113e0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:38:49Z,use_quota=True,user_id='4769730abb3148ab9215acde01c78f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Creating volume 40e68f13-4f3b-48db-a8e7-3d093b78f341 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:38:49 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:49 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 1073741824 Aug 20 06:38:49 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:49 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 1073741824" returned: 0 in 0.522s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:49 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 Aug 20 06:38:49 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:50 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3de49d-64cc-4925-bd3b-f4e64f27f49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e68f13-4f3b-48db-a8e7-3d093b78f341', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d293c5f-ae23-4f97-8dc4-0e53cad60297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:38:50 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Volume volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 (40e68f13-4f3b-48db-a8e7-3d093b78f341): created successfully Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d293c5f-ae23-4f97-8dc4-0e53cad60297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:38:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Flow 'volume_create_manager' (10e72085-557c-49ec-a06f-f2df35df71be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:38:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b57afc14-d612-4150-a1dc-efe15b8d0f99 tempest-ServersNegativeTestJSON-1186279642 None] Created volume successfully. Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "cinder-40e68f13-4f3b-48db-a8e7-3d093b78f341-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-40e68f13-4f3b-48db-a8e7-3d093b78f341-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "cinder-quobyte-40e68f13-4f3b-48db-a8e7-3d093b78f341" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-quobyte-40e68f13-4f3b-48db-a8e7-3d093b78f341" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c037d-6b3e-49a6-ab4e-98f736840dcd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:52 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 Aug 20 06:38:52 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:52 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341" returned: 0 in 0.417s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:52 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341 Aug 20 06:38:52 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:52 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-40e68f13-4f3b-48db-a8e7-3d093b78f341" returned: 0 in 0.296s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-quobyte-40e68f13-4f3b-48db-a8e7-3d093b78f341" released by "delete_volume" :: held 0.772s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Created reservations ['264299b0-a977-4ad6-8e76-98e01ae75d6f', 'f26b8436-15a1-4d8c-b5b8-59152931bf30', 'd5330f13-d9f3-414e-8786-9527f6d2dc77', 'fd450eb1-664c-4503-948c-589d36006a1c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:52 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:52 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "cinder-d9e0fd76-f4c9-4062-983d-32eae09b8d87-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-d9e0fd76-f4c9-4062-983d-32eae09b8d87-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "cinder-quobyte-d9e0fd76-f4c9-4062-983d-32eae09b8d87" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-quobyte-d9e0fd76-f4c9-4062-983d-32eae09b8d87" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[96453ab6-349e-4c47-9434-5023e43ba2ce]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:53 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.409s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Deleted volume successfully. Aug 20 06:38:53 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 Aug 20 06:38:53 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-efea58bc-3c0d-4eb8-aa80-9bf75bccacc7 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-40e68f13-4f3b-48db-a8e7-3d093b78f341-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:53 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87" returned: 0 in 0.668s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:53 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87 Aug 20 06:38:53 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:54 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9e0fd76-f4c9-4062-983d-32eae09b8d87" returned: 0 in 0.448s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-quobyte-d9e0fd76-f4c9-4062-983d-32eae09b8d87" released by "delete_volume" :: held 1.172s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Created reservations ['6bf7555c-c72d-4542-adef-036e45e16e92', '2ae68de9-a1c9-498f-b140-6efc74aa6a2b', '41f53c0b-7b0b-4bd5-bbc2-12a557dafbae', '7566ce6a-3681-4134-a266-28bf2e99a115'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:38:54 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:38:54 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:38:54 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:38:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Deleted volume successfully. Aug 20 06:38:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1756c67f-787b-431c-bc26-5c4c48b66915 tempest-ServersNegativeTestJSON-1186279642 None] Lock "cinder-d9e0fd76-f4c9-4062-983d-32eae09b8d87-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-3a799220-f4d9-4be5-bda7-7cfddf29c19c tempest-ServerActionsTestOtherA-1452494096 None] Terminate volume connection completed successfully. Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-3a799220-f4d9-4be5-bda7-7cfddf29c19c tempest-ServerActionsTestOtherA-1452494096 None] Deleting attachment f6d5e7fa-cf19-4a0b-8d98-ef1c0f722798. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "cinder-87aa57dc-8159-4704-9ab6-531cd5f64c70-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-87aa57dc-8159-4704-9ab6-531cd5f64c70-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "cinder-quobyte-87aa57dc-8159-4704-9ab6-531cd5f64c70" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-quobyte-87aa57dc-8159-4704-9ab6-531cd5f64c70" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c302d92f-dbd2-4d4e-98e7-1ca3765fdd38]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:02 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 Aug 20 06:39:02 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:02 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70" returned: 0 in 0.451s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:03 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70 Aug 20 06:39:03 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:03 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-87aa57dc-8159-4704-9ab6-531cd5f64c70" returned: 0 in 0.346s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-quobyte-87aa57dc-8159-4704-9ab6-531cd5f64c70" released by "delete_volume" :: held 0.888s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.quota [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Created reservations ['77341a2c-99cc-4d1e-bbb7-3a1e8f92fb7d', '73787670-faa0-43f3-8ec1-e7364fe8ee12', 'a61f0e2e-fa6e-4610-9785-25af1e4ca39a', 'a775e281-af98-4692-8dfb-e0229dd11fe0'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:03 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:03 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:03 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.manager [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Deleted volume successfully. Aug 20 06:39:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-583e7d28-8b9d-433c-9348-f352e3d1d7e5 req-49390ae6-00fe-4611-a25c-4b9a4df92527 tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-87aa57dc-8159-4704-9ab6-531cd5f64c70-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "cinder-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "cinder-quobyte-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-quobyte-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f4e04f-5248-4150-9c0c-d360e6a0ea10]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:04 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa Aug 20 06:39:04 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:05 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" returned: 0 in 0.463s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:05 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa Aug 20 06:39:05 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:05 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-quobyte-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa" released by "delete_volume" :: held 0.860s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Created reservations ['fe0fae1a-ea8b-4979-80e4-30871d9bbb04', '025e34d4-9478-4a62-9526-a0a0dfc473ab', 'ed48f3af-7d7e-4e97-a184-cddf778f7b60', 'c5ba3706-eeb0-4ce7-8404-84979d1a08a2'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:05 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:05 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:06 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.417s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:06 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Deleted volume successfully. Aug 20 06:39:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c4f1efbc-fea7-45eb-8183-204fa56bd86f tempest-ServerActionsTestOtherA-1452494096 None] Lock "cinder-04bdf7e7-6f6a-4fe2-9d26-75f78795f1fa-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Flow 'volume_create_manager' (4303f79f-4d2c-47fd-b407-3075f416f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6669fe43-92fc-4061-8ce4-d49b04d46387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6669fe43-92fc-4061-8ce4-d49b04d46387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-845691133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f92555-a217-4a40-a78e-4fc40a06be9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcbde77d8ad49cba726c6fc09ca12f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:09Z,use_quota=True,user_id='ca1f862daba84d6886ff7c74fbb36d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be24fd-8829-44b2-bfdb-a399ab482bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be24fd-8829-44b2-bfdb-a399ab482bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620e652a-d4d6-40cb-af2d-a1e637971b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620e652a-d4d6-40cb-af2d-a1e637971b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f92555-a217-4a40-a78e-4fc40a06be9a', 'volume_name': 'volume-e8f92555-a217-4a40-a78e-4fc40a06be9a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c90279-56f2-49cf-8103-58ea6a2ed513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c90279-56f2-49cf-8103-58ea6a2ed513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e583ba4-4d56-4060-802f-7e7a247ff67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Volume e8f92555-a217-4a40-a78e-4fc40a06be9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f92555-a217-4a40-a78e-4fc40a06be9a', 'volume_size': 1} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-845691133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f92555-a217-4a40-a78e-4fc40a06be9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcbde77d8ad49cba726c6fc09ca12f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:09Z,use_quota=True,user_id='ca1f862daba84d6886ff7c74fbb36d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Creating volume e8f92555-a217-4a40-a78e-4fc40a06be9a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:09 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a 1073741824 Aug 20 06:39:09 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:10 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a 1073741824" returned: 0 in 0.737s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:10 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a Aug 20 06:39:10 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:10 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e583ba4-4d56-4060-802f-7e7a247ff67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f92555-a217-4a40-a78e-4fc40a06be9a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b1cccf-eaec-4919-af41-0b1ec22b3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Volume volume-e8f92555-a217-4a40-a78e-4fc40a06be9a (e8f92555-a217-4a40-a78e-4fc40a06be9a): created successfully Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b1cccf-eaec-4919-af41-0b1ec22b3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Flow 'volume_create_manager' (4303f79f-4d2c-47fd-b407-3075f416f16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c059fac6-e911-47a7-ba0d-4dabed7b9daf tempest-AbsoluteLimitsTests-973873238 None] Created volume successfully. Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Acquiring lock "cinder-e8f92555-a217-4a40-a78e-4fc40a06be9a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "cinder-e8f92555-a217-4a40-a78e-4fc40a06be9a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Acquiring lock "cinder-quobyte-e8f92555-a217-4a40-a78e-4fc40a06be9a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "cinder-quobyte-e8f92555-a217-4a40-a78e-4fc40a06be9a" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50a78d-9236-4606-8a5a-b2cb43037e72]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:11 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a Aug 20 06:39:11 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:12 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a" returned: 0 in 0.510s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:12 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a Aug 20 06:39:12 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:12 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e8f92555-a217-4a40-a78e-4fc40a06be9a" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "cinder-quobyte-e8f92555-a217-4a40-a78e-4fc40a06be9a" released by "delete_volume" :: held 0.860s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Created reservations ['b06ccb17-0952-4b39-8313-6e1ab0049d35', '2968e8e7-89ae-4380-978f-7cd8ca201c71', '777139b6-33ca-4f17-b97f-5a685ab01da3', '0bc37552-31c1-416c-bc7e-6b0bb2b7e1fd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:12 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:12 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:13 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.333s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:13 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Deleted volume successfully. Aug 20 06:39:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3366933f-e3e0-4084-9c14-f6df2639e9eb tempest-AbsoluteLimitsTests-973873238 None] Lock "cinder-e8f92555-a217-4a40-a78e-4fc40a06be9a-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Flow 'volume_create_manager' (ed01bbce-42bd-4b58-96f9-78bc9d36a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24301d5-eef8-46dc-8def-521e7955b3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24301d5-eef8-46dc-8def-521e7955b3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2078908697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee84697b-3df2-434c-9afa-cc93a5bac772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5183da7823d344c3abbf77c2b56f7601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:20Z,use_quota=True,user_id='69703737e3514f6dba17f5f3e6b6acc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c69ff9-8233-488c-9c72-c8709b8f8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c69ff9-8233-488c-9c72-c8709b8f8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cfff41-5d84-4ed5-a463-350da69b4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cfff41-5d84-4ed5-a463-350da69b4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee84697b-3df2-434c-9afa-cc93a5bac772', 'volume_name': 'volume-ee84697b-3df2-434c-9afa-cc93a5bac772', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcc01e7-5ca5-4038-b114-b149f3b93326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcc01e7-5ca5-4038-b114-b149f3b93326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5762d532-4394-4a81-bd54-efe18a9a5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Volume ee84697b-3df2-434c-9afa-cc93a5bac772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee84697b-3df2-434c-9afa-cc93a5bac772', 'volume_size': 1} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2078908697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee84697b-3df2-434c-9afa-cc93a5bac772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5183da7823d344c3abbf77c2b56f7601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:20Z,use_quota=True,user_id='69703737e3514f6dba17f5f3e6b6acc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Creating volume ee84697b-3df2-434c-9afa-cc93a5bac772 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:20 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:20 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 1073741824 Aug 20 06:39:20 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:21 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 1073741824" returned: 0 in 1.049s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:21 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 Aug 20 06:39:21 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:22 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772" returned: 0 in 0.414s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5762d532-4394-4a81-bd54-efe18a9a5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee84697b-3df2-434c-9afa-cc93a5bac772', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e80eba-fdba-4023-a884-7f9f12313659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Volume volume-ee84697b-3df2-434c-9afa-cc93a5bac772 (ee84697b-3df2-434c-9afa-cc93a5bac772): created successfully Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e80eba-fdba-4023-a884-7f9f12313659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Flow 'volume_create_manager' (ed01bbce-42bd-4b58-96f9-78bc9d36a079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-50928f86-b4f7-4449-acda-8604d4567163 tempest-VolumesMetadataTest-1280040744 None] Created volume successfully. Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Acquiring lock "cinder-ee84697b-3df2-434c-9afa-cc93a5bac772-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "cinder-ee84697b-3df2-434c-9afa-cc93a5bac772-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Flow 'volume_create_manager' (6f767441-274a-433a-ab3c-824460feb9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad926da-e2c7-4a71-b16e-1151c6d88cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad926da-e2c7-4a71-b16e-1151c6d88cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1554666877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47d111cb59da41829d024476d5d2bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:24Z,use_quota=True,user_id='eab71f528d2f41e7949d74f4b153dcac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92e6b4-ed01-4e5b-adb5-e691567bf333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92e6b4-ed01-4e5b-adb5-e691567bf333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5a0e60-a0e4-48f9-a6ff-adc8a184d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5a0e60-a0e4-48f9-a6ff-adc8a184d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0', 'volume_name': 'volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2616fba-4c0d-419f-af20-e9ca5e7dd653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2616fba-4c0d-419f-af20-e9ca5e7dd653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788159b4-2f33-4f24-b2bf-d03a89c00c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Volume 6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0', 'volume_size': 1} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1554666877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47d111cb59da41829d024476d5d2bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:24Z,use_quota=True,user_id='eab71f528d2f41e7949d74f4b153dcac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Creating volume 6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Acquiring lock "cinder-quobyte-ee84697b-3df2-434c-9afa-cc93a5bac772" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:24 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 1073741824 Aug 20 06:39:24 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "cinder-quobyte-ee84697b-3df2-434c-9afa-cc93a5bac772" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f582a0-4b3a-4e9b-8644-3d247a6b65ca]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:24 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 Aug 20 06:39:24 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:25 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 1073741824" returned: 0 in 0.659s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:25 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 Aug 20 06:39:25 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:25 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772" returned: 0 in 0.707s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:25 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772 Aug 20 06:39:25 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:25 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee84697b-3df2-434c-9afa-cc93a5bac772" returned: 0 in 0.398s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "cinder-quobyte-ee84697b-3df2-434c-9afa-cc93a5bac772" released by "delete_volume" :: held 1.190s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Created reservations ['30380d5e-d077-49e4-af93-6f49cf4bcbfe', 'c5e83436-13e2-4311-82e6-1a71ce21871b', 'df9d7d58-7d8e-4062-b5b0-d24485f224d2', '049a81f7-413a-4bac-bb62-29727599624b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:25 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" returned: 0 in 0.705s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788159b4-2f33-4f24-b2bf-d03a89c00c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f9149-5849-4340-a606-b37e86b6361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:26 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Volume volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 (6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0): created successfully Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f9149-5849-4340-a606-b37e86b6361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Flow 'volume_create_manager' (6f767441-274a-433a-ab3c-824460feb9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:26 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:26 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-a04fc673-1754-4bf5-bc45-0e273e307901 req-c44ee28c-c475-43c1-b439-29afc0fa86f7 tempest-VolumesGetTestJSON-1654195747 None] Created volume successfully. Aug 20 06:39:26 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.357s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Deleted volume successfully. Aug 20 06:39:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cd9a996e-47a6-4ffb-ab2e-bd3d3837c8f1 tempest-VolumesMetadataTest-1280040744 None] Lock "cinder-ee84697b-3df2-434c-9afa-cc93a5bac772-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Acquiring lock "cinder-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "cinder-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Acquiring lock "cinder-quobyte-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "cinder-quobyte-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" acquired by "delete_volume" :: waited 0.063s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:28 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6642f222-7414-46a7-8fea-b0da4a105381]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:28 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 Aug 20 06:39:28 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:28 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" returned: 0 in 0.762s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:28 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0 Aug 20 06:39:28 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:29 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" returned: 0 in 0.423s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "cinder-quobyte-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0" released by "delete_volume" :: held 1.286s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG cinder.quota [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Created reservations ['24bbdbf4-616f-424d-a4d0-fa1909b83a97', '286f582f-4ee3-4937-9967-b5d418bfeb13', 'ff288fe0-5876-4648-acba-f958b6f94d66', 'ebab843f-d716-4c2d-a46e-c5dfcc836f46'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=80,cinder:SELECT=57,cinder:INSERT=24,cinder:DELETE=8 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=59,cinder:UPDATE=92,cinder:INSERT=18,cinder:DELETE=6 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:29 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:29 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:29 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.463s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:30 devstack cinder-volume[94234]: DEBUG cinder.manager [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Deleted volume successfully. Aug 20 06:39:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-8764dc76-26a7-4235-9a82-4a834bf0f995 req-18e8a854-4dcf-44d2-8eae-206fe1b4204c tempest-VolumesGetTestJSON-1654195747 None] Lock "cinder-6bd9381d-26f9-4dd6-ba03-cbe94c50d3c0-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:34 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:34 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:34 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.351s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:39:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Flow 'volume_create_manager' (4dcde93f-9c3b-457f-8774-33db267cb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57651834-d867-4ff7-ace2-8b6d4bcacf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57651834-d867-4ff7-ace2-8b6d4bcacf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-950673965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3a060e-b930-43e2-b40e-95a3f2a6384a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91adc5de6784f7d9301e51659ba2419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:35Z,use_quota=True,user_id='3d7d08528fc04b79aaba874ff0907138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e6e98-43f7-4beb-998e-a5c6617dc48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e6e98-43f7-4beb-998e-a5c6617dc48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6a5ef-bbdd-4d86-861a-5709da90e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6a5ef-bbdd-4d86-861a-5709da90e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3a060e-b930-43e2-b40e-95a3f2a6384a', 'volume_name': 'volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2229bf3a-f4d0-4da3-824d-a0612fb5d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2229bf3a-f4d0-4da3-824d-a0612fb5d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec28154-136a-4a2b-aeb6-b99fb724b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:35 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Volume 1b3a060e-b930-43e2-b40e-95a3f2a6384a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a', 'volume_size': 1} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-950673965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3a060e-b930-43e2-b40e-95a3f2a6384a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91adc5de6784f7d9301e51659ba2419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:35Z,use_quota=True,user_id='3d7d08528fc04b79aaba874ff0907138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Creating volume 1b3a060e-b930-43e2-b40e-95a3f2a6384a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:35 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:35 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a 1073741824 Aug 20 06:39:35 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:35 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a 1073741824" returned: 0 in 0.600s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:35 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a Aug 20 06:39:35 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:36 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec28154-136a-4a2b-aeb6-b99fb724b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf06b161-5d10-449e-9616-6263a0822073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:36 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Volume volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a (1b3a060e-b930-43e2-b40e-95a3f2a6384a): created successfully Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf06b161-5d10-449e-9616-6263a0822073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Flow 'volume_create_manager' (4dcde93f-9c3b-457f-8774-33db267cb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b1384e95-6174-41f3-bb74-a8a49f17e476 tempest-VolumesTransfersV355Test-1468928249 None] Created volume successfully. Aug 20 06:39:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-efc07e80-afbc-4ca9-996d-0c8c80906ed4 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-560733476: creating Aug 20 06:39:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-efc07e80-afbc-4ca9-996d-0c8c80906ed4 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-560733476: created successfully Aug 20 06:39:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-efc07e80-afbc-4ca9-996d-0c8c80906ed4 tempest-GroupSnapshotsTest-2064933387 None] Create group completed successfully. Aug 20 06:39:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-97a3cfd0-cddf-4e7c-bc32-112f97d1b276 tempest-VolumesTransfersV355Test-1288459749 None] Transfer volume completed successfully. Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (d123d33c-ddf6-4475-8435-04bc41cf9ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad61aab-116d-45a2-bd5a-f07209830a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad61aab-116d-45a2-bd5a-f07209830a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143156400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d5b4622-af12-4b8e-a811-1151780dc8e9,host='devstack@QuobyteHD#QuobyteHD',id=4adc74be-b34d-435f-bb8c-01ca9813dfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:38Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7f5794-941e-4dbf-99a4-aeece035bbc4),volume_type_id=9b7f5794-941e-4dbf-99a4-aeece035bbc4)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b96c226-9696-4885-a738-17aa5af2877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b96c226-9696-4885-a738-17aa5af2877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c85f694-5622-491d-935e-d0dd1335b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c85f694-5622-491d-935e-d0dd1335b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adc74be-b34d-435f-bb8c-01ca9813dfb9', 'volume_name': 'volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfd9f9a-b286-4d09-b31e-25a0ccfdff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfd9f9a-b286-4d09-b31e-25a0ccfdff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7896c-9e4b-4368-b772-798dfb08730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Volume 4adc74be-b34d-435f-bb8c-01ca9813dfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9', 'volume_size': 1} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d5b4622-af12-4b8e-a811-1151780dc8e9,created_at=2026-08-20T04:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143156400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d5b4622-af12-4b8e-a811-1151780dc8e9,host='devstack@QuobyteHD#QuobyteHD',id=4adc74be-b34d-435f-bb8c-01ca9813dfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:38Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7f5794-941e-4dbf-99a4-aeece035bbc4),volume_type_id=9b7f5794-941e-4dbf-99a4-aeece035bbc4)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Creating volume 4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:38 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:38 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 1073741824 Aug 20 06:39:38 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:38 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 1073741824" returned: 0 in 0.536s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "cinder-1b3a060e-b930-43e2-b40e-95a3f2a6384a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:38 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:39:38 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-1b3a060e-b930-43e2-b40e-95a3f2a6384a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "cinder-quobyte-1b3a060e-b930-43e2-b40e-95a3f2a6384a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-quobyte-1b3a060e-b930-43e2-b40e-95a3f2a6384a" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c454af-11db-469f-8b24-b2b54ac05b5a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:39 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a Aug 20 06:39:39 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:39 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7896c-9e4b-4368-b772-798dfb08730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cac9a3-5e63-49c6-b6ec-8ffcb6992b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Volume volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 (4adc74be-b34d-435f-bb8c-01ca9813dfb9): created successfully Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cac9a3-5e63-49c6-b6ec-8ffcb6992b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (d123d33c-ddf6-4475-8435-04bc41cf9ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-31723fb5-cd22-47b7-887a-534a77888a0f tempest-GroupSnapshotsTest-2064933387 None] Created volume successfully. Aug 20 06:39:39 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a" returned: 0 in 0.501s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:39 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a Aug 20 06:39:39 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:39 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1b3a060e-b930-43e2-b40e-95a3f2a6384a" returned: 0 in 0.577s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] GroupSnapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: creating. Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-quobyte-1b3a060e-b930-43e2-b40e-95a3f2a6384a" released by "delete_volume" :: held 1.205s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Group snapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: creating. {{(pid=94234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Creating offline snapshot 40704678-f7cc-41dc-8c79-d10cd716e322 of volume 4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e64a3-00b2-4fb6-8c3e-4a9901474809]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Created reservations ['15a22f26-81e5-47cf-ae12-fccc4c4ebd31', '7dc230a9-dc77-486a-9c63-cb64e67cfd23', '320c7701-42a6-4050-8555-fc5c0c413a83', '419d5735-53f2-444f-9d74-9370189956e3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:40 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:39:40 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:40 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:40 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:40 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.426s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Deleted volume successfully. Aug 20 06:39:40 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.670s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:40 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 1G Aug 20 06:39:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b6fa24cc-60aa-4fe3-abf6-7dcee5e5d825 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-1b3a060e-b930-43e2-b40e-95a3f2a6384a-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:40 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:41 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 1G" returned: 0 in 0.622s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:41 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:39:41 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:41 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:41 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:39:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:41 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:39:41 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Flow 'volume_create_manager' (7547434a-165c-4ee9-a94a-6e7151149d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad3779b-49ec-40dc-9495-df4afdb827ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad3779b-49ec-40dc-9495-df4afdb827ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04bb45c-0b09-4689-a599-fcd20a8cf6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91adc5de6784f7d9301e51659ba2419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:42Z,use_quota=True,user_id='3d7d08528fc04b79aaba874ff0907138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7101f1-21f1-4f05-873c-1d4cc9b14fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7101f1-21f1-4f05-873c-1d4cc9b14fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9328762d-9d33-4fbf-9aa1-2306b38edf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9328762d-9d33-4fbf-9aa1-2306b38edf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04bb45c-0b09-4689-a599-fcd20a8cf6e9', 'volume_name': 'volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824be4cc-ab93-4a14-b67e-1ef10ae4139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824be4cc-ab93-4a14-b67e-1ef10ae4139e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d387ca-622d-49b8-bf3c-a36ffb124456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Volume b04bb45c-0b09-4689-a599-fcd20a8cf6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9', 'volume_size': 1} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:42 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.537s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:42 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info Aug 20 06:39:42 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:42 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info" returned: 0 in 0.438s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:42 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:39:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:42 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info Aug 20 06:39:42 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:43 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.info" returned: 0 in 0.268s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04bb45c-0b09-4689-a599-fcd20a8cf6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91adc5de6784f7d9301e51659ba2419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:42Z,use_quota=True,user_id='3d7d08528fc04b79aaba874ff0907138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Creating volume b04bb45c-0b09-4689-a599-fcd20a8cf6e9 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:43 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:43 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 1073741824 Aug 20 06:39:43 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e80f467b-786c-4e22-b84d-357f9a36b299 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: created successfully Aug 20 06:39:43 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 1073741824" returned: 0 in 0.464s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:43 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 Aug 20 06:39:43 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:44 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" returned: 0 in 0.288s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d387ca-622d-49b8-bf3c-a36ffb124456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5117a25e-c03c-488e-b631-789b8d161d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:44 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Volume volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 (b04bb45c-0b09-4689-a599-fcd20a8cf6e9): created successfully Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5117a25e-c03c-488e-b631-789b8d161d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Flow 'volume_create_manager' (7547434a-165c-4ee9-a94a-6e7151149d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-63399aba-3504-4a88-b02b-9331171a441f tempest-VolumesTransfersV355Test-1468928249 None] Created volume successfully. Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (2632af39-2826-4b15-b74b-d5a22223b330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa962de5-71e2-42d1-85bd-7e2133dea482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa962de5-71e2-42d1-85bd-7e2133dea482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-279998156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babcf87-3519-4d12-98e8-d4a4f3cfcead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:45Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aea0de8-70c7-4c7a-92b0-78e45e596f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aea0de8-70c7-4c7a-92b0-78e45e596f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8c83e-e99d-4742-9d53-538989f498f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8c83e-e99d-4742-9d53-538989f498f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3babcf87-3519-4d12-98e8-d4a4f3cfcead', 'volume_name': 'volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446047ad-9b66-4f94-870a-b5bacb4b242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446047ad-9b66-4f94-870a-b5bacb4b242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ebf6b6-aa86-4b25-aa87-a8f1121e8f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Volume 3babcf87-3519-4d12-98e8-d4a4f3cfcead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead', 'volume_size': 1} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-279998156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babcf87-3519-4d12-98e8-d4a4f3cfcead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:39:45Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Creating volume 3babcf87-3519-4d12-98e8-d4a4f3cfcead {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:45 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead 1073741824 Aug 20 06:39:45 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "cinder-b04bb45c-0b09-4689-a599-fcd20a8cf6e9-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-b04bb45c-0b09-4689-a599-fcd20a8cf6e9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "cinder-quobyte-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-quobyte-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f2c7a6-363d-41f2-aee4-5fceb87d3b9d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:46 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 Aug 20 06:39:46 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:46 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead 1073741824" returned: 0 in 0.871s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:46 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead Aug 20 06:39:46 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:46 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" returned: 0 in 0.608s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:46 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9 Aug 20 06:39:46 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:47 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead" returned: 0 in 0.351s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.685s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ebf6b6-aa86-4b25-aa87-a8f1121e8f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab734a-be6e-4b98-acff-7ddfa8090b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Creating volume 325cfe7f-dabe-406b-b4ae-dcc2179ade6e from snapshot 40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:47 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Volume volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead (3babcf87-3519-4d12-98e8-d4a4f3cfcead): created successfully Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab734a-be6e-4b98-acff-7ddfa8090b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (2632af39-2826-4b15-b74b-d5a22223b330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:39:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b5f57af3-8e9d-4bc9-a3ac-7f45f54d476c tempest-AttachVolumeNegativeTest-1918186608 None] Created volume successfully. Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] snapshot: 40704678-f7cc-41dc-8c79-d10cd716e322, volume: 325cfe7f-dabe-406b-b4ae-dcc2179ade6e, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:39:47 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" returned: 0 in 0.372s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-quobyte-b04bb45c-0b09-4689-a599-fcd20a8cf6e9" released by "delete_volume" :: held 1.124s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac98b63c-a63b-49c6-9a4e-62791bfd740b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Created reservations ['f242a51f-5efb-45d6-af54-0dc982e5d142', 'd30bff41-830d-43a3-b356-da939c29555c', '49d428da-95cf-49fa-999d-8ac0fc35d467', '6897539e-b689-4a4b-b2f9-cde409b0318f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:47 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:39:47 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:47 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:47 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:47 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.550s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa6caa-560d-4e86-9ee7-8308ecc8dff1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:47 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.466s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Deleted volume successfully. Aug 20 06:39:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ba38ff25-1608-40e5-a60c-14b7dc3a5e74 tempest-VolumesTransfersV355Test-181341100 None] Lock "cinder-b04bb45c-0b09-4689-a599-fcd20a8cf6e9-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:48 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:39:48 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:48 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.578s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:48 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e Aug 20 06:39:48 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-50c14094-4687-455b-95a7-b81611acb9a0 req-ef3c2c96-1744-4b48-9441-4aee84c25f59 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:54 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" returned: 0 in 6.204s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:39:54 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Converted 1024.00 MB image at 165.01 MB/s Aug 20 06:39:54 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:54 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e Aug 20 06:39:54 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:54 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" returned: 0 in 0.298s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" released by "_copy_volume_from_snapshot" :: held 7.766s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" released by "_create_volume_from_snapshot" :: held 7.892s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.940s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-50c14094-4687-455b-95a7-b81611acb9a0 req-ef3c2c96-1744-4b48-9441-4aee84c25f59 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.296s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-50c14094-4687-455b-95a7-b81611acb9a0 req-ef3c2c96-1744-4b48-9441-4aee84c25f59 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-50c14094-4687-455b-95a7-b81611acb9a0 req-ef3c2c96-1744-4b48-9441-4aee84c25f59 tempest-AttachVolumeNegativeTest-1918186608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1190f3d6-7dd2-460f-8525-e74bb475b2bd', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:39:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ebbc01d6-020b-4eec-9498-b78a304c21f3 tempest-GroupSnapshotsTest-2064933387 None] Create group from source-snapshot-006b5fe9-34e3-4f3a-a5d2-3e2254722939 completed successfully. Aug 20 06:39:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-50c14094-4687-455b-95a7-b81611acb9a0 req-ef3c2c96-1744-4b48-9441-4aee84c25f59 tempest-AttachVolumeNegativeTest-1918186608 None] attachment_update completed successfully. Aug 20 06:39:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2bb24f-9068-4866-beb7-834d42a5d390]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:56 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e Aug 20 06:39:56 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:57 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" returned: 0 in 0.762s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:57 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e Aug 20 06:39:57 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:57 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-325cfe7f-dabe-406b-b4ae-dcc2179ade6e" released by "delete_volume" :: held 1.143s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['2e845541-562e-494f-b78c-b658c6478c1f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:57 devstack cinder-volume[94234]: WARNING cinder.quota [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1392882170 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1392882170, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:39:57 devstack cinder-volume[94234]: WARNING cinder.quota [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1392882170 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1392882170, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['c47762e2-04c0-493e-9536-af3cd9cc651f', '4e02a91d-1536-49e9-9692-668aeffec75b', '6edd359a-fe76-40a2-9d81-e246f47f2b80', '6e1c7c83-6b49-4d4e-96c3-6f944b3619ac'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:39:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:57 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:39:57 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:58 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.306s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:39:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4bbb461e-cbb8-4e61-8242-1042e194544b tempest-GroupSnapshotsTest-2064933387 None] Delete group completed successfully. Aug 20 06:39:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: deleting Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: deleting {{(pid=94234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:39:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Deleting offline snapshot 40704678-f7cc-41dc-8c79-d10cd716e322 of volume 4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] snapshot_file for this snap is: volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db8701b-fa41-4f6d-a131-0589530be432]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:59 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:39:59 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:39:59 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.444s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3082e-f9a2-4aaa-b619-d9ebc27c624e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:39:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:39:59 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:39:59 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:00 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.606s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:00 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:40:00 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:00 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:00 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322 Aug 20 06:40:00 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:00 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9.40704678-f7cc-41dc-8c79-d10cd716e322" returned: 0 in 0.318s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-40704678-f7cc-41dc-8c79-d10cd716e322" released by "_delete_snapshot" :: held 1.956s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" released by "delete_snapshot" :: held 1.985s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Flow 'volume_create_manager' (248eb36d-323f-4205-9da7-4be17fe934d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40eea5-7b04-472d-b721-2efde33d9da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40eea5-7b04-472d-b721-2efde33d9da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-471197470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57e62abdae448e8e674ad3ef3cb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:01Z,use_quota=True,user_id='4e67ef69f0ba48bd98aaeb76e3904c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056383d-df54-4a5d-85d2-c44a7b2db1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056383d-df54-4a5d-85d2-c44a7b2db1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d54eeb5-1482-49f8-9215-def6d807c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d54eeb5-1482-49f8-9215-def6d807c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ba4e81-2af7-47ec-a4af-ccc62ec9ea80', 'volume_name': 'volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591c3cbd-8944-4698-8041-b1dd3974a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591c3cbd-8944-4698-8041-b1dd3974a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7e1bc8-2c51-4c91-97b9-9d5b1e4a84a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:01 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Volume d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80', 'volume_size': 1} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-471197470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57e62abdae448e8e674ad3ef3cb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:01Z,use_quota=True,user_id='4e67ef69f0ba48bd98aaeb76e3904c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Creating volume d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:01 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:01 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 1073741824 Aug 20 06:40:01 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:01 devstack cinder-volume[94234]: WARNING cinder.quota [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1392882170 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1392882170, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['a49dcc44-60c1-4a31-b434-24bdf5435178', '361f3d7c-4cdd-4d93-b782-ae8e21bc8f6d', '5678b601-2099-4b83-b038-a7f7c368cd6a', '73efc78d-ec27-46ea-afbb-6411968d8751'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-79755508-a0eb-485f-a7f4-7fd2669a51db tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 006b5fe9-34e3-4f3a-a5d2-3e2254722939: deleted successfully Aug 20 06:40:01 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 1073741824" returned: 0 in 0.584s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:01 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 Aug 20 06:40:01 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:02 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7e1bc8-2c51-4c91-97b9-9d5b1e4a84a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e651327-3dfd-4bda-a491-86087e7df83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:02 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Volume volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 (d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80): created successfully Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e651327-3dfd-4bda-a491-86087e7df83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Flow 'volume_create_manager' (248eb36d-323f-4205-9da7-4be17fe934d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ca26d44c-7d14-418c-8826-a766f7ecd34e tempest-VolumesTransfersV357Test-637349597 None] Created volume successfully. Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb882c-e4d8-4bbc-bd23-8aad7ebd83d0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:02 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:40:02 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:03 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.574s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:03 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9 Aug 20 06:40:03 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:03 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4adc74be-b34d-435f-bb8c-01ca9813dfb9" returned: 0 in 0.408s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-4adc74be-b34d-435f-bb8c-01ca9813dfb9" released by "delete_volume" :: held 1.088s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['047a9638-33c2-4b3f-a999-2b5329c04d53'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:03 devstack cinder-volume[94234]: WARNING cinder.db.api [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1392882170'] Aug 20 06:40:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['0736482b-8155-4546-87db-f4d3f1f1f71f', 'a55d3b99-a66c-4ffe-8a34-176b36156a92', '23a0dfdb-e7d1-44b0-927a-7c0b47f15d77', 'ea2a7b94-dedc-4e59-8212-4af0fe7e7747'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:04 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:04 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5b429677-64e3-4e88-9b9d-b51fd90f4e49 tempest-VolumesTransfersV357Test-450921739 None] Transfer volume completed successfully. Aug 20 06:40:04 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.394s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-30a8ba78-48c0-4b74-aaca-347b73a91d50 tempest-GroupSnapshotsTest-2064933387 None] Delete group completed successfully. Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "cinder-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "cinder-quobyte-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-quobyte-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab787f-5cac-4c39-be3c-aaa0ad93c64c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:05 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 Aug 20 06:40:05 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:05 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:05 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80 Aug 20 06:40:05 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4dea30ba-84da-495a-a13f-50deeefc00a7 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-1431414944: creating Aug 20 06:40:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4dea30ba-84da-495a-a13f-50deeefc00a7 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-1431414944: created successfully Aug 20 06:40:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4dea30ba-84da-495a-a13f-50deeefc00a7 tempest-GroupSnapshotsTest-2064933387 None] Create group completed successfully. Aug 20 06:40:05 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" returned: 0 in 0.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-quobyte-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80" released by "delete_volume" :: held 1.026s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Created reservations ['77d923cd-b8e6-4d86-9c74-18036610322a', '9deb9031-7aa0-470b-a5ca-9a050f226319', '4dee6d85-01f4-4102-b21a-196fd837f5c8', 'e06ef89a-7169-4ea8-a9df-cc576cdc907e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:06 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:06 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:06 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.460s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Deleted volume successfully. Aug 20 06:40:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f1efebe6-14b9-48b7-b5e5-d1ef2cdfec02 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-d1ba4e81-2af7-47ec-a4af-ccc62ec9ea80-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (c624fa96-6299-402a-8b6a-0e8d9b993594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400856fe-aa99-41f7-9b0d-d74fc68f1ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400856fe-aa99-41f7-9b0d-d74fc68f1ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-115251703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56ea0b-82c9-4b50-b171-7d9100f181ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:07Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f12cdd6-fc70-42a7-b94c-075f6aa51025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f12cdd6-fc70-42a7-b94c-075f6aa51025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35db04d-35cf-422c-a87e-67320b9028e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35db04d-35cf-422c-a87e-67320b9028e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f56ea0b-82c9-4b50-b171-7d9100f181ca', 'volume_name': 'volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9049f8c5-1adb-415c-a426-3a5085489e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9049f8c5-1adb-415c-a426-3a5085489e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21d6cf-26be-41c2-a547-2fb4e87a1789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Volume 6f56ea0b-82c9-4b50-b171-7d9100f181ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca', 'volume_size': 1} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-115251703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56ea0b-82c9-4b50-b171-7d9100f181ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:07Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Creating volume 6f56ea0b-82c9-4b50-b171-7d9100f181ca {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:07 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:07 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca 1073741824 Aug 20 06:40:07 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (07959da5-e86f-4317-90a4-6ca1c859a66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faef8b0-e0a6-4a9c-9459-bc5f263f2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faef8b0-e0a6-4a9c-9459-bc5f263f2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878152882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,host='devstack@QuobyteHD#QuobyteHD',id=b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:08Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4639fe1-2ecb-468e-9f4c-2edf126e9d92),volume_type_id=d4639fe1-2ecb-468e-9f4c-2edf126e9d92)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae99b6-228d-4db1-b1e7-f65f245323b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae99b6-228d-4db1-b1e7-f65f245323b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2d7e9-501d-427c-b7ef-f65dd9bf4aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2d7e9-501d-427c-b7ef-f65dd9bf4aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8', 'volume_name': 'volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b77eb60-3f72-4a7a-a287-7991c92b549d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b77eb60-3f72-4a7a-a287-7991c92b549d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e009da5-46cb-450e-a05f-9a1930e0ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Volume b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8', 'volume_size': 1} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:08 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca 1073741824" returned: 0 in 0.728s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Flow 'volume_create_manager' (3c705181-e602-42ca-9641-e7b228c4b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d31d2cd-5874-4c74-9f90-14feb5d9ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d31d2cd-5874-4c74-9f90-14feb5d9ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2146523784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ebb84-b390-426a-b63f-e4d1a29bdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57e62abdae448e8e674ad3ef3cb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:08Z,use_quota=True,user_id='4e67ef69f0ba48bd98aaeb76e3904c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2394ef-3bfb-4d27-83a7-4bd8be04d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2394ef-3bfb-4d27-83a7-4bd8be04d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd7d125-f588-4361-86d5-01484d45a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd7d125-f588-4361-86d5-01484d45a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15ebb84-b390-426a-b63f-e4d1a29bdce6', 'volume_name': 'volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9531a7-fd9e-4b4d-8377-cc3d96a4dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9531a7-fd9e-4b4d-8377-cc3d96a4dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602bc271-6b93-497d-b2f8-f4ae2cac66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Volume d15ebb84-b390-426a-b63f-e4d1a29bdce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6', 'volume_size': 1} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:08 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca Aug 20 06:40:08 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:08 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca" returned: 0 in 0.253s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,created_at=2026-08-20T04:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878152882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,host='devstack@QuobyteHD#QuobyteHD',id=b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:08Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4639fe1-2ecb-468e-9f4c-2edf126e9d92),volume_type_id=d4639fe1-2ecb-468e-9f4c-2edf126e9d92)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Creating volume b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:08 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21d6cf-26be-41c2-a547-2fb4e87a1789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96aa36fb-1f0a-405b-a189-5c4ac124303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:08 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 1073741824 Aug 20 06:40:08 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Volume volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca (6f56ea0b-82c9-4b50-b171-7d9100f181ca): created successfully Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96aa36fb-1f0a-405b-a189-5c4ac124303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (c624fa96-6299-402a-8b6a-0e8d9b993594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-16250348-a4e5-434b-9a6f-fe13027f0e39 tempest-AttachVolumeTestJSON-1774153121 None] Created volume successfully. Aug 20 06:40:09 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 1073741824" returned: 0 in 0.538s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:09 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 Aug 20 06:40:09 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:09 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2146523784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ebb84-b390-426a-b63f-e4d1a29bdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57e62abdae448e8e674ad3ef3cb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:08Z,use_quota=True,user_id='4e67ef69f0ba48bd98aaeb76e3904c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Creating volume d15ebb84-b390-426a-b63f-e4d1a29bdce6 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e009da5-46cb-450e-a05f-9a1930e0ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:09 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 1073741824 Aug 20 06:40:09 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69856a79-64b3-4556-bdce-625692443208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Volume volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 (b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8): created successfully Aug 20 06:40:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69856a79-64b3-4556-bdce-625692443208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (07959da5-e86f-4317-90a4-6ca1c859a66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9225680d-0427-424d-8c53-3d69e659d0a4 tempest-GroupSnapshotsTest-2064933387 None] Created volume successfully. Aug 20 06:40:10 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 1073741824" returned: 0 in 0.664s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:10 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 Aug 20 06:40:10 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d5881a2e-a6aa-479b-a5a8-f0abccb19990 req-fd25b75c-474d-4365-812d-aa9625c63e6a tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:11 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6" returned: 0 in 0.429s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d5881a2e-a6aa-479b-a5a8-f0abccb19990 req-fd25b75c-474d-4365-812d-aa9625c63e6a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.190s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d5881a2e-a6aa-479b-a5a8-f0abccb19990 req-fd25b75c-474d-4365-812d-aa9625c63e6a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602bc271-6b93-497d-b2f8-f4ae2cac66cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f71c3e-145a-431a-89eb-946d2d067289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Volume volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 (d15ebb84-b390-426a-b63f-e4d1a29bdce6): created successfully Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f71c3e-145a-431a-89eb-946d2d067289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Flow 'volume_create_manager' (3c705181-e602-42ca-9641-e7b228c4b160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b4d122b4-36a5-476a-940f-55aa435605a9 tempest-VolumesTransfersV357Test-637349597 None] Created volume successfully. Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-d5881a2e-a6aa-479b-a5a8-f0abccb19990 req-fd25b75c-474d-4365-812d-aa9625c63e6a tempest-AttachVolumeTestJSON-1774153121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d60c39a-eb73-4998-840b-124e716c133d', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (c8f21bea-4191-4619-8840-8c19e7788d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ad0664-94fd-46bb-a424-a9493f20d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-d5881a2e-a6aa-479b-a5a8-f0abccb19990 req-fd25b75c-474d-4365-812d-aa9625c63e6a tempest-AttachVolumeTestJSON-1774153121 None] attachment_update completed successfully. Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ad0664-94fd-46bb-a424-a9493f20d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137081045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,host='devstack@QuobyteHD#QuobyteHD',id=c477c48b-2743-47d3-a9eb-4ae0484ab022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:11Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4639fe1-2ecb-468e-9f4c-2edf126e9d92),volume_type_id=d4639fe1-2ecb-468e-9f4c-2edf126e9d92)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b209f7d-8f0a-4bd5-a6d9-d331a9a042d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b209f7d-8f0a-4bd5-a6d9-d331a9a042d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98663d7-46c2-4969-9cbe-ba24d527146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98663d7-46c2-4969-9cbe-ba24d527146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c477c48b-2743-47d3-a9eb-4ae0484ab022', 'volume_name': 'volume-c477c48b-2743-47d3-a9eb-4ae0484ab022', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0321632e-9cba-4b78-97cc-ad207f5a1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0321632e-9cba-4b78-97cc-ad207f5a1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438b1229-e9fc-4f1a-9eeb-18d7b6caf9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:11 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Volume c477c48b-2743-47d3-a9eb-4ae0484ab022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c477c48b-2743-47d3-a9eb-4ae0484ab022', 'volume_size': 1} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,created_at=2026-08-20T04:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137081045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e35977c-1b36-471d-aa44-e6fe11c3f971,host='devstack@QuobyteHD#QuobyteHD',id=c477c48b-2743-47d3-a9eb-4ae0484ab022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:11Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4639fe1-2ecb-468e-9f4c-2edf126e9d92),volume_type_id=d4639fe1-2ecb-468e-9f4c-2edf126e9d92)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Creating volume c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:11 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:11 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 1073741824 Aug 20 06:40:11 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "cinder-d15ebb84-b390-426a-b63f-e4d1a29bdce6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-d15ebb84-b390-426a-b63f-e4d1a29bdce6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "cinder-quobyte-d15ebb84-b390-426a-b63f-e4d1a29bdce6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-quobyte-d15ebb84-b390-426a-b63f-e4d1a29bdce6" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06ca40c-7133-4582-a30e-d4acc48bd2d0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:12 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 1073741824" returned: 0 in 1.078s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:12 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 Aug 20 06:40:12 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:12 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 Aug 20 06:40:12 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:13 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022" returned: 0 in 0.385s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438b1229-e9fc-4f1a-9eeb-18d7b6caf9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c477c48b-2743-47d3-a9eb-4ae0484ab022', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a67994-6810-4cdb-82c3-7102f7577dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Volume volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 (c477c48b-2743-47d3-a9eb-4ae0484ab022): created successfully Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a67994-6810-4cdb-82c3-7102f7577dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:13 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (c8f21bea-4191-4619-8840-8c19e7788d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6" returned: 0 in 0.748s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:13 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6 Aug 20 06:40:13 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e0327266-b654-4514-91b6-c65ab1e2f837 tempest-GroupSnapshotsTest-2064933387 None] Created volume successfully. Aug 20 06:40:13 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d15ebb84-b390-426a-b63f-e4d1a29bdce6" returned: 0 in 0.456s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-quobyte-d15ebb84-b390-426a-b63f-e4d1a29bdce6" released by "delete_volume" :: held 1.269s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Created reservations ['bba8d065-6e3a-4d1f-9fca-24f7e777f5a1', 'ba1a8beb-01be-4154-986c-0f994f6fceca', '6f34caf3-a7b2-4845-a1de-81fff8855851', '8a770c22-1619-443d-b04f-f4ac0d437e13'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:13 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:13 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:14 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:14 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Deleted volume successfully. Aug 20 06:40:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0f4fddbd-3027-4d55-a015-7d237cf03a68 tempest-VolumesTransfersV357Test-977555605 None] Lock "cinder-d15ebb84-b390-426a-b63f-e4d1a29bdce6-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-20e10c6a-089b-47b0-8877-f6225901f4c1 tempest-GroupSnapshotsTest-2064933387 None] Update group completed successfully. Aug 20 06:40:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1ce8e899-c2a6-4888-b46d-094ad7640272 tempest-GroupSnapshotsTest-2064933387 None] Update group completed successfully. Aug 20 06:40:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b582377d-df55-4f54-9297-f9527d97b6a8 tempest-GroupSnapshotsTest-2064933387 None] Update group completed successfully. Aug 20 06:40:18 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e1c07c1f-0240-4866-9908-8c289404b05d tempest-GroupSnapshotsTest-2064933387 None] Update group completed successfully. Aug 20 06:40:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] GroupSnapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: creating. Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Group snapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: creating. {{(pid=94234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Creating offline snapshot 939d5f57-8a6f-44db-a72e-31cab7cb0a81 of volume b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e293b8a-3cdc-4dd4-8507-571473a176fb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:20 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 Aug 20 06:40:20 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:21 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:21 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 1G Aug 20 06:40:21 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:22 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 1G" returned: 0 in 1.011s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:22 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 Aug 20 06:40:22 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:22 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81" returned: 0 in 0.470s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:22 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:22 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 Aug 20 06:40:22 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:22 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81" returned: 0 in 0.288s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:22 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info Aug 20 06:40:22 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:23 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:23 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:23 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info Aug 20 06:40:23 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:23 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.info" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Creating offline snapshot a36336a8-5223-4892-ba2a-ff9ba2d735bb of volume c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4089330-af98-4d33-8632-e054c4c5fc5a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:23 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 Aug 20 06:40:23 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:24 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022" returned: 0 in 0.459s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:24 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb 1G Aug 20 06:40:24 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:24 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb 1G" returned: 0 in 0.532s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:24 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb Aug 20 06:40:24 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:25 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:25 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:25 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb Aug 20 06:40:25 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:25 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb" returned: 0 in 0.302s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:25 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info Aug 20 06:40:25 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:25 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info" returned: 0 in 0.306s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:25 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:25 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info Aug 20 06:40:25 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:25 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.info" returned: 0 in 0.273s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4810e463-28e3-4630-93ee-33e668797dc6 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: created successfully Aug 20 06:40:27 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: deleting Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: deleting {{(pid=94234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-939d5f57-8a6f-44db-a72e-31cab7cb0a81" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-939d5f57-8a6f-44db-a72e-31cab7cb0a81" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Deleting offline snapshot 939d5f57-8a6f-44db-a72e-31cab7cb0a81 of volume b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] snapshot_file for this snap is: volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8bc85-c17a-46e1-8b9d-887a1522dc9e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:27 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 Aug 20 06:40:27 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:27 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81" returned: 0 in 0.619s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b090e-a18c-4761-8d50-caed43de6a16]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:28 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 Aug 20 06:40:28 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:28 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" returned: 0 in 0.415s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:28 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 Aug 20 06:40:28 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:28 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81" returned: 0 in 0.442s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:28 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81 Aug 20 06:40:28 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:29 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8.939d5f57-8a6f-44db-a72e-31cab7cb0a81" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-939d5f57-8a6f-44db-a72e-31cab7cb0a81" released by "_delete_snapshot" :: held 2.159s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" released by "delete_snapshot" :: held 2.187s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-a36336a8-5223-4892-ba2a-ff9ba2d735bb" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-a36336a8-5223-4892-ba2a-ff9ba2d735bb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Deleting offline snapshot a36336a8-5223-4892-ba2a-ff9ba2d735bb of volume c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] snapshot_file for this snap is: volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d446533b-924b-41f1-a3be-efe1c4a25647]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:29 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb Aug 20 06:40:29 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:30 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb" returned: 0 in 0.495s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c477c48b-2743-47d3-a9eb-4ae0484ab022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86fd679-87ba-4a85-b196-1dfae5e4de20]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:30 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 Aug 20 06:40:30 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:30 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022" returned: 0 in 0.668s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:30 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb Aug 20 06:40:30 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:31 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb" returned: 0 in 0.548s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:31 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb Aug 20 06:40:31 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:31 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022.a36336a8-5223-4892-ba2a-ff9ba2d735bb" returned: 0 in 0.524s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-a36336a8-5223-4892-ba2a-ff9ba2d735bb" released by "_delete_snapshot" :: held 2.495s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" released by "delete_snapshot" :: held 2.533s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:31 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=119,cinder:UPDATE=105,cinder:DELETE=6,cinder:INSERT=21 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:40:32 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=112,cinder:DELETE=8,cinder:SELECT=99,cinder:INSERT=22 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:40:32 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-553760746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-553760746, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:32 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-553760746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-553760746, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['111abf55-e57a-4827-8688-4246d9237c0c', 'fc986ab5-bc1e-4890-9272-8b1017c286f1', '5e658f0f-b25d-4cb1-8858-50fa691abfc5', '9b146a66-5eaa-41c1-9eb2-40df65277c72'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['d5b284d3-5947-4ecd-95b4-d2dd4d0bcc28', 'f57e1298-0d17-4594-881c-a28525e8a6e5', '492f8dea-43f5-452c-a0db-8cf421abf32c', 'd81cdc48-4d00-4222-8a7e-827b0eca8f91'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7ff71889-0d07-4a66-843c-e86108360d53 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot c0b72cd2-a78a-472f-a93d-6fa2e0ef61e7: deleted successfully Aug 20 06:40:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7dafa6-dfbe-4274-8e6d-f820fc91e8ef]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:33 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 Aug 20 06:40:33 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:34 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" returned: 0 in 0.744s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:34 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8 Aug 20 06:40:34 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:34 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:34 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:34 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-b3710a8c-bc06-4ece-8fe0-2eeb5c1affc8" released by "delete_volume" :: held 1.445s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" acquired by "delete_volume" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:34 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.607s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a69e4-dc31-4dd6-aa53-221574ebc1e6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:35 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 Aug 20 06:40:35 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:35 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022" returned: 0 in 0.507s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:35 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022 Aug 20 06:40:35 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:35 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c477c48b-2743-47d3-a9eb-4ae0484ab022" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-c477c48b-2743-47d3-a9eb-4ae0484ab022" released by "delete_volume" :: held 1.014s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['ce4840f4-de39-41fd-987b-0730eb5fb867'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:36 devstack cinder-volume[94234]: WARNING cinder.quota [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-553760746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-553760746, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['65e05eca-c45a-420a-a1ec-d7eeb1822749', '2898f5a1-1274-420b-90fb-ac5b81260e81', '4aa77575-8d9a-4937-8bdc-eba459eb81d3', '09b326f9-bb29-4cf3-b0df-c9a0dad79af8'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['cc4da8d0-60ef-418e-b154-a47ffd57db39', '09ac9f92-2c84-4303-8084-7cacd4358a3a', 'b32d68a6-ce85-4914-a07a-f5b90fad4475', 'e8e264ad-b74a-4b69-9427-c1c488b3da88'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:36 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:36 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:36 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.384s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-685011a1-d60f-4ce8-9e79-03fbd83d39bd tempest-GroupSnapshotsTest-2064933387 None] Delete group completed successfully. Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (0d833376-f53a-400a-b16f-e5a66613cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a97e2f5-d392-4970-a0ad-d33c84cc077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a97e2f5-d392-4970-a0ad-d33c84cc077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113156945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d91c511-c20a-4129-bf33-98a78a3cddee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:37Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9bdb7a-f909-4ecf-8de7-d804425cc4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9bdb7a-f909-4ecf-8de7-d804425cc4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4790d8b-e5ef-4cf5-bb98-a531b36837a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4790d8b-e5ef-4cf5-bb98-a531b36837a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d91c511-c20a-4129-bf33-98a78a3cddee', 'volume_name': 'volume-6d91c511-c20a-4129-bf33-98a78a3cddee', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d11f7-1d15-4b78-9551-ee280e7f7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d11f7-1d15-4b78-9551-ee280e7f7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826d568-ca04-4fa9-b7a0-4ed21a49cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:37 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Volume 6d91c511-c20a-4129-bf33-98a78a3cddee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d91c511-c20a-4129-bf33-98a78a3cddee', 'volume_size': 1} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113156945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d91c511-c20a-4129-bf33-98a78a3cddee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:37Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Creating volume 6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:37 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:37 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee 1073741824 Aug 20 06:40:37 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b3db8c28-6aa3-40d7-9fe6-e216850f8441 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-1738629551: creating Aug 20 06:40:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b3db8c28-6aa3-40d7-9fe6-e216850f8441 tempest-GroupSnapshotsTest-2064933387 None] Group tempest-GroupSnapshotsTest-Group-1738629551: created successfully Aug 20 06:40:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b3db8c28-6aa3-40d7-9fe6-e216850f8441 tempest-GroupSnapshotsTest-2064933387 None] Create group completed successfully. Aug 20 06:40:37 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee 1073741824" returned: 0 in 0.461s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:38 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee Aug 20 06:40:38 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:38 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee" returned: 0 in 0.256s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826d568-ca04-4fa9-b7a0-4ed21a49cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d91c511-c20a-4129-bf33-98a78a3cddee', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43522da-6078-462f-bc9d-12a25276e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Volume volume-6d91c511-c20a-4129-bf33-98a78a3cddee (6d91c511-c20a-4129-bf33-98a78a3cddee): created successfully Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43522da-6078-462f-bc9d-12a25276e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (0d833376-f53a-400a-b16f-e5a66613cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e73cc7ab-0da0-4f28-8458-bbceaf614b2e tempest-VolumesSnapshotTestJSON-87972829 None] Created volume successfully. Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (7e97c195-e98d-4a82-a5ef-79aa70e0ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3819e9-25ec-43f6-9e92-b8fc87b79616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3819e9-25ec-43f6-9e92-b8fc87b79616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420787287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a932893-aee1-4b63-9e80-321c960023ba,host='devstack@QuobyteHD#QuobyteHD',id=0f73e3fe-9bfc-427e-8f72-32c79b3f615b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:39Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ded15d3-3525-4ac8-8793-381ac7854205),volume_type_id=0ded15d3-3525-4ac8-8793-381ac7854205)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58ff9f2-259c-498a-a68b-caa2bbe31dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58ff9f2-259c-498a-a68b-caa2bbe31dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8665464b-4b30-44e8-8131-a6dec9ba0fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8665464b-4b30-44e8-8131-a6dec9ba0fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f73e3fe-9bfc-427e-8f72-32c79b3f615b', 'volume_name': 'volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f570e95b-62c0-4a20-ac35-1f9147ae4dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f570e95b-62c0-4a20-ac35-1f9147ae4dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3588ec-380c-4334-86d1-16425564e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Volume 0f73e3fe-9bfc-427e-8f72-32c79b3f615b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b', 'volume_size': 1} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a932893-aee1-4b63-9e80-321c960023ba,created_at=2026-08-20T04:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420787287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a932893-aee1-4b63-9e80-321c960023ba,host='devstack@QuobyteHD#QuobyteHD',id=0f73e3fe-9bfc-427e-8f72-32c79b3f615b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20ab1bab69d48b09769bf43bb398070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:39Z,use_quota=True,user_id='047223ab304545dfb354d30577aafd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ded15d3-3525-4ac8-8793-381ac7854205),volume_type_id=0ded15d3-3525-4ac8-8793-381ac7854205)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Creating volume 0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:39 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:39 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b 1073741824 Aug 20 06:40:39 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-b5006041-dac9-4e3e-9f78-4952b404c8ff req-5edfd347-3ee5-4ce9-b9bb-fac0ba622d6f tempest-AttachVolumeNegativeTest-1918186608 None] Terminate volume connection completed successfully. Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-b5006041-dac9-4e3e-9f78-4952b404c8ff req-5edfd347-3ee5-4ce9-b9bb-fac0ba622d6f tempest-AttachVolumeNegativeTest-1918186608 None] Deleting attachment 1190f3d6-7dd2-460f-8525-e74bb475b2bd. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:40:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:40 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b 1073741824" returned: 0 in 0.550s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:40 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b Aug 20 06:40:40 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:40 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" returned: 0 in 0.252s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.445s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3588ec-380c-4334-86d1-16425564e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4258994-1961-43b7-9515-a0a556d4b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Creating offline snapshot 3128b70f-a0fb-44e4-8913-f63905eadece of volume 6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:40:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Volume volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b (0f73e3fe-9bfc-427e-8f72-32c79b3f615b): created successfully Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4258994-1961-43b7-9515-a0a556d4b09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Flow 'volume_create_manager' (7e97c195-e98d-4a82-a5ef-79aa70e0ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c139362d-0981-486e-9c8e-ac51fd6e56fd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cb6c0235-11dc-4505-ae53-f641faec55b3 tempest-GroupSnapshotsTest-2064933387 None] Created volume successfully. Aug 20 06:40:40 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee Aug 20 06:40:40 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:40 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee" returned: 0 in 0.424s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:40 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece 1G Aug 20 06:40:40 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] GroupSnapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: creating. Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Group snapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: creating. {{(pid=94234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 20 06:40:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:41 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece 1G" returned: 0 in 0.619s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d91c511-c20a-4129-bf33-98a78a3cddee -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:41 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d91c511-c20a-4129-bf33-98a78a3cddee -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece Aug 20 06:40:41 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:41 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d91c511-c20a-4129-bf33-98a78a3cddee -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:41 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece is being set with open permissions: ugo+rw Aug 20 06:40:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:41 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece Aug 20 06:40:41 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:42 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:42 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info Aug 20 06:40:42 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info" returned: 0 in 0.369s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:42 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:42 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info is being set with open permissions: ugo+rw Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:42 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info Aug 20 06:40:42 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:42 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.info" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Creating offline snapshot e5c5fd16-9eca-4472-bd66-365030f4574e of volume 0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:40:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2c288-9195-4168-9320-afdbf727df76]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5c17b851-3906-454d-adc0-76467fbf35cb tempest-VolumesSnapshotTestJSON-87972829 None] Create snapshot completed successfully Aug 20 06:40:43 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b Aug 20 06:40:43 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:43 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" returned: 0 in 0.597s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:43 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e 1G Aug 20 06:40:43 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-542ca4bc-e356-4de2-8268-1ed8434777a4 req-bdec52c5-36f7-4c33-825a-670abec18823 tempest-AttachVolumeTestJSON-1774153121 None] Terminate volume connection completed successfully. Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-542ca4bc-e356-4de2-8268-1ed8434777a4 req-bdec52c5-36f7-4c33-825a-670abec18823 tempest-AttachVolumeTestJSON-1774153121 None] Deleting attachment 2d60c39a-eb73-4998-840b-124e716c133d. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:40:44 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e 1G" returned: 0 in 0.623s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-3128b70f-a0fb-44e4-8913-f63905eadece-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-3128b70f-a0fb-44e4-8913-f63905eadece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:44 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e Aug 20 06:40:44 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-3128b70f-a0fb-44e4-8913-f63905eadece" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-3128b70f-a0fb-44e4-8913-f63905eadece" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Deleting offline snapshot 3128b70f-a0fb-44e4-8913-f63905eadece of volume 6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] snapshot_file for this snap is: volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e48f7c-c637-44ec-9959-1e1be7833070]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:44 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece Aug 20 06:40:44 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:44 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e" returned: 0 in 0.593s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:44 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:44 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e Aug 20 06:40:44 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:45 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece" returned: 0 in 0.663s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d91c511-c20a-4129-bf33-98a78a3cddee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:40:45 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ffee00-0280-4387-a255-4fbbaf78792a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e" returned: 0 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:45 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info Aug 20 06:40:45 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:45 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee Aug 20 06:40:45 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:45 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee" returned: 0 in 0.504s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:45 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece Aug 20 06:40:45 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:45 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info" returned: 0 in 0.501s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:45 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:40:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:45 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info Aug 20 06:40:45 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:46 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.info" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:46 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:46 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece Aug 20 06:40:46 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-08e8e2cb-6dbe-4634-bcad-814c51fecd7b tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: created successfully Aug 20 06:40:46 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee.3128b70f-a0fb-44e4-8913-f63905eadece" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-3128b70f-a0fb-44e4-8913-f63905eadece" released by "_delete_snapshot" :: held 2.115s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" released by "delete_snapshot" :: held 2.155s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:46 devstack cinder-volume[94234]: WARNING cinder.quota [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['4eb5bd79-72f6-4bb7-90e2-7a1b6b338820', '970ec15e-f39a-4a5a-a037-46d5250fcdcb', '78d61287-a6aa-4ee4-b091-589a071a9db6', '06544c98-178f-4763-8fc2-6691c6354541'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Delete snapshot completed successfully. Aug 20 06:40:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82c9708e-9e64-47a6-80cb-5fd8934e060f tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-3128b70f-a0fb-44e4-8913-f63905eadece-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: deleting Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: deleting {{(pid=94234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-e5c5fd16-9eca-4472-bd66-365030f4574e" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-e5c5fd16-9eca-4472-bd66-365030f4574e" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Deleting offline snapshot e5c5fd16-9eca-4472-bd66-365030f4574e of volume 0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] snapshot_file for this snap is: volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fffb4e-2fa7-43d4-b583-0f4cf885c49e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:48 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e Aug 20 06:40:48 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:48 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e" returned: 0 in 0.674s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a98bcf-4994-4136-ab2d-c9be44b652cb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (232fb086-3649-4379-a155-db47ad1618ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:48 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f049930-80a0-4d52-8dfb-cf6caec5c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:48 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f049930-80a0-4d52-8dfb-cf6caec5c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-386364437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c055d604-6424-4e18-990e-aa5d49815927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:49Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f37db2-67bc-443f-8c83-4ba4616cd99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f37db2-67bc-443f-8c83-4ba4616cd99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503cccd2-274d-47a7-be19-188016f4f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503cccd2-274d-47a7-be19-188016f4f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c055d604-6424-4e18-990e-aa5d49815927', 'volume_name': 'volume-c055d604-6424-4e18-990e-aa5d49815927', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7dbbe5-fda0-46ae-a8c7-e62a5027874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7dbbe5-fda0-46ae-a8c7-e62a5027874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac4f22a-6b8d-488f-b267-6a2e18ec814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Volume c055d604-6424-4e18-990e-aa5d49815927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c055d604-6424-4e18-990e-aa5d49815927', 'volume_size': 1} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-386364437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c055d604-6424-4e18-990e-aa5d49815927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:49Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Creating volume c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:48 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:40:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:48 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 1073741824 Aug 20 06:40:48 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:49 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" returned: 0 in 0.850s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:49 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e Aug 20 06:40:49 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:50 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 1073741824" returned: 0 in 1.159s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:50 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:40:50 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:50 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e" returned: 0 in 0.770s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:50 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e Aug 20 06:40:50 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:50 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.399s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac4f22a-6b8d-488f-b267-6a2e18ec814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c055d604-6424-4e18-990e-aa5d49815927', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de5eef-a24c-4bde-834d-9f7a61d802cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:50 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Volume volume-c055d604-6424-4e18-990e-aa5d49815927 (c055d604-6424-4e18-990e-aa5d49815927): created successfully Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de5eef-a24c-4bde-834d-9f7a61d802cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (232fb086-3649-4379-a155-db47ad1618ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ec112e11-d703-46f6-be49-c2396fd77465 tempest-VolumesSnapshotTestJSON-87972829 None] Created volume successfully. Aug 20 06:40:50 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b.e5c5fd16-9eca-4472-bd66-365030f4574e" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-e5c5fd16-9eca-4472-bd66-365030f4574e" released by "_delete_snapshot" :: held 2.941s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" released by "delete_snapshot" :: held 2.999s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:50 devstack cinder-volume[94234]: WARNING cinder.quota [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1557966897 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1557966897, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:50 devstack cinder-volume[94234]: WARNING cinder.quota [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1557966897 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1557966897, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:50 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['fc7647c0-fc8d-4750-a507-1c2fda7d9e82', '627cd223-1736-411a-a684-a318e3abaf16', '794f3545-7ea0-4023-bd8f-4cb0bbbabb25', '2abb7685-bcd2-444c-92e1-33d9589b3941'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-131b8fa4-6d1b-4b38-bd8b-5de84b976485 tempest-GroupSnapshotsTest-2064933387 None] group_snapshot 194fbe51-3ade-49aa-9fc6-ace25c459497: deleted successfully Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Creating offline snapshot 84dafc05-683b-40bb-9b2e-c829f36c143e of volume c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d240a8-db93-4852-890f-0ebb2554c90b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:51 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:40:51 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" acquired by "delete_volume" :: waited 0.063s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11f045-1b5a-45cf-a442-e81995ca906d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:52 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.822s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:52 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e 1G Aug 20 06:40:52 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:52 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b Aug 20 06:40:52 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:53 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" returned: 0 in 0.854s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:53 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b Aug 20 06:40:53 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:53 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e 1G" returned: 0 in 1.050s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c055d604-6424-4e18-990e-aa5d49815927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:53 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c055d604-6424-4e18-990e-aa5d49815927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:40:53 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:53 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" returned: 0 in 0.586s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Lock "cinder-quobyte-0f73e3fe-9bfc-427e-8f72-32c79b3f615b" released by "delete_volume" :: held 1.650s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['689e9289-34ba-43c5-898c-b299a8d060e4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:53 devstack cinder-volume[94234]: WARNING cinder.quota [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1557966897 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1557966897, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:40:53 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Created reservations ['9e8f05dc-8ddf-4c72-8c00-8e90bb6948a5', '9e306a03-a11b-4769-97b9-b55325c18526', '67a74530-3b8e-4346-8fb7-237ed60b4861', '3398c6f7-8a4c-46ea-971f-dc52681e40c5'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:40:54 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c055d604-6424-4e18-990e-aa5d49815927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.713s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:54 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e is being set with open permissions: ugo+rw Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:54 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:40:54 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:54 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:40:54 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:54 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.366s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:54 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info Aug 20 06:40:54 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:54 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.424s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:40:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1c292c9b-addc-4c5d-b392-a31c294f9e57 tempest-GroupSnapshotsTest-2064933387 None] Delete group completed successfully. Aug 20 06:40:54 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:54 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info is being set with open permissions: ugo+rw Aug 20 06:40:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:54 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info Aug 20 06:40:54 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:55 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.info" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.805s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1668f586-e518-469f-b35b-5d5faaf61eb3 tempest-VolumesSnapshotTestJSON-87972829 None] Create snapshot completed successfully Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (17cf0673-bf66-4d0b-afed-5aad3b7de442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d918e8-b0a0-4517-a6ac-5758bd12fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d918e8-b0a0-4517-a6ac-5758bd12fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1159101671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe31b85-a448-41a3-babe-3adee9c32403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:40:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=84dafc05-683b-40bb-9b2e-c829f36c143e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:40:56Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34b42f2-da07-400a-aaab-f78f675f7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34b42f2-da07-400a-aaab-f78f675f7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbc1b67-7741-4d3a-8b58-c457cb5f89ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbc1b67-7741-4d3a-8b58-c457cb5f89ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fe31b85-a448-41a3-babe-3adee9c32403', 'volume_name': 'volume-1fe31b85-a448-41a3-babe-3adee9c32403', 'volume_size': 2, 'snapshot_id': '84dafc05-683b-40bb-9b2e-c829f36c143e'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8b3805-c614-40ee-918d-ab697652654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8b3805-c614-40ee-918d-ab697652654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64081ebc-8342-4e5a-ac3e-b79a8675b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:40:56 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Volume 1fe31b85-a448-41a3-babe-3adee9c32403: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fe31b85-a448-41a3-babe-3adee9c32403', 'volume_size': 2, 'snapshot_id': '84dafc05-683b-40bb-9b2e-c829f36c143e'} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e-1fe31b85-a448-41a3-babe-3adee9c32403" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e-1fe31b85-a448-41a3-babe-3adee9c32403" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Creating volume 1fe31b85-a448-41a3-babe-3adee9c32403 from snapshot 84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] snapshot: 84dafc05-683b-40bb-9b2e-c829f36c143e, volume: 1fe31b85-a448-41a3-babe-3adee9c32403, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9986703-580f-459c-ba00-b0b702195ad5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:56 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:40:56 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:57 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.566s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c055d604-6424-4e18-990e-aa5d49815927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[150df809-fe9e-4d4c-af90-50cada88dfc3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:57 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:40:57 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:40:57 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.523s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:40:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:40:57 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 Aug 20 06:40:57 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:06 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=63,cinder:INSERT=18,cinder:UPDATE=76,cinder:DELETE=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:41:06 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=84,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=2 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:41:06 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403" returned: 0 in 9.106s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:06 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927, size 1024.00 MB, duration 9.11 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:41:06 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Converted 1024.00 MB image at 112.42 MB/s Aug 20 06:41:06 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 is being set with open permissions: ugo+rw Aug 20 06:41:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:06 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 Aug 20 06:41:06 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:07 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403" returned: 0 in 0.302s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" released by "_copy_volume_from_snapshot" :: held 10.658s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e-1fe31b85-a448-41a3-babe-3adee9c32403" released by "_create_volume_from_snapshot" :: held 10.769s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.802s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64081ebc-8342-4e5a-ac3e-b79a8675b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe31b85-a448-41a3-babe-3adee9c32403', 'volume_size': 2, 'snapshot_id': '84dafc05-683b-40bb-9b2e-c829f36c143e'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19b43c-fd20-4536-848d-36e5b332911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Volume volume-1fe31b85-a448-41a3-babe-3adee9c32403 (1fe31b85-a448-41a3-babe-3adee9c32403): created successfully Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19b43c-fd20-4536-848d-36e5b332911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (17cf0673-bf66-4d0b-afed-5aad3b7de442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-21172084-9131-45d2-a1f5-d529abcb2530 tempest-VolumesSnapshotTestJSON-87972829 None] Created volume successfully. Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-1fe31b85-a448-41a3-babe-3adee9c32403-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-38efd108-a2f8-465d-92c0-48f9aca7f301 tempest-GroupSnapshotsV319Test-1112490374 None] Group tempest-GroupSnapshotsV319Test-Group-1545931850: creating Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-1fe31b85-a448-41a3-babe-3adee9c32403-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-38efd108-a2f8-465d-92c0-48f9aca7f301 tempest-GroupSnapshotsV319Test-1112490374 None] Group tempest-GroupSnapshotsV319Test-Group-1545931850: created successfully Aug 20 06:41:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-38efd108-a2f8-465d-92c0-48f9aca7f301 tempest-GroupSnapshotsV319Test-1112490374 None] Create group completed successfully. Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1766b259-b9e3-461b-86e3-da0d0833672d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:08 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 Aug 20 06:41:08 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:08 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:08 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403 Aug 20 06:41:08 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:08 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1fe31b85-a448-41a3-babe-3adee9c32403" returned: 0 in 0.279s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-1fe31b85-a448-41a3-babe-3adee9c32403" released by "delete_volume" :: held 0.772s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['cf6ab46e-2ec5-4f97-a385-5f0b9a7a70a4', '719740d0-67f6-47d9-ba90-974b3c34343f', '40e276cc-f531-499d-be9b-ed058affdbc7', 'bb43e906-6d22-4f8e-84e2-fdb180cf0c5b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:09 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:09 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-84dafc05-683b-40bb-9b2e-c829f36c143e-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-84dafc05-683b-40bb-9b2e-c829f36c143e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Deleting offline snapshot 84dafc05-683b-40bb-9b2e-c829f36c143e of volume c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] snapshot_file for this snap is: volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cbad59-049c-4bfa-922c-3bc0b26d93af]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:09 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.400s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Deleted volume successfully. Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-30d23934-265d-4051-884b-88dafab94ef6 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-1fe31b85-a448-41a3-babe-3adee9c32403-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:09 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:41:09 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:09 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.476s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c055d604-6424-4e18-990e-aa5d49815927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[29333222-2a77-44fa-9523-03887b02d7dc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:09 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Flow 'volume_create_manager' (a45d7d92-5fcd-4447-a8d5-a4f26acdf048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9f8626-a390-4b02-a214-a47c905832e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9f8626-a390-4b02-a214-a47c905832e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325216146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413091a-92dd-44fb-a5a9-2d7d5a3661af,host='devstack@QuobyteHD#QuobyteHD',id=942b1f7e-a71a-4104-926b-59f99a06480c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31835d61d2c4bebad863a498e71ae38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:10Z,use_quota=True,user_id='5f7c3c8307a64fb9a26cf94fc08e57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(815533e4-a327-48a9-94ac-988796646848),volume_type_id=815533e4-a327-48a9-94ac-988796646848)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6173f2-56ac-4a95-8d14-1836bcb811ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6173f2-56ac-4a95-8d14-1836bcb811ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce75826-7b89-4e07-8825-b3512a5952e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce75826-7b89-4e07-8825-b3512a5952e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942b1f7e-a71a-4104-926b-59f99a06480c', 'volume_name': 'volume-942b1f7e-a71a-4104-926b-59f99a06480c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710b2e48-3974-4eea-a71c-d5b0d2137ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710b2e48-3974-4eea-a71c-d5b0d2137ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6579ab4-3cc4-4c4a-a6a6-150466b0795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Volume 942b1f7e-a71a-4104-926b-59f99a06480c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942b1f7e-a71a-4104-926b-59f99a06480c', 'volume_size': 1} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c413091a-92dd-44fb-a5a9-2d7d5a3661af,created_at=2026-08-20T04:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325216146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413091a-92dd-44fb-a5a9-2d7d5a3661af,host='devstack@QuobyteHD#QuobyteHD',id=942b1f7e-a71a-4104-926b-59f99a06480c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31835d61d2c4bebad863a498e71ae38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:10Z,use_quota=True,user_id='5f7c3c8307a64fb9a26cf94fc08e57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(815533e4-a327-48a9-94ac-988796646848),volume_type_id=815533e4-a327-48a9-94ac-988796646848)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Creating volume 942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:41:10 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:10 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:41:10 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:10 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c 1073741824 Aug 20 06:41:10 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:10 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c 1073741824" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:10 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.598s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:10 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:41:10 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:10 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c Aug 20 06:41:10 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:10 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c" returned: 0 in 0.258s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6579ab4-3cc4-4c4a-a6a6-150466b0795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942b1f7e-a71a-4104-926b-59f99a06480c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1d675d-6b3c-4eb1-8aea-144e19899725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Volume volume-942b1f7e-a71a-4104-926b-59f99a06480c (942b1f7e-a71a-4104-926b-59f99a06480c): created successfully Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1d675d-6b3c-4eb1-8aea-144e19899725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Flow 'volume_create_manager' (a45d7d92-5fcd-4447-a8d5-a4f26acdf048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-75d267c5-1fb5-4999-a589-d5983bbf641c tempest-GroupSnapshotsV319Test-1112490374 None] Created volume successfully. Aug 20 06:41:10 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:10 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e Aug 20 06:41:10 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:11 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927.84dafc05-683b-40bb-9b2e-c829f36c143e" returned: 0 in 0.260s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-84dafc05-683b-40bb-9b2e-c829f36c143e" released by "_delete_snapshot" :: held 1.850s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" released by "delete_snapshot" :: held 1.879s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['daa487ba-e3c1-496d-b752-26196926ee65', '4815d422-87e9-47e8-8bbf-8c56b4ec2a75', '23f34f59-c7dd-4a03-98e3-d2d0bb91e24f', '5889aa20-81f5-41d3-989d-aa7a93fb437a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] GroupSnapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: creating. Aug 20 06:41:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Delete snapshot completed successfully. Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6b526dd3-23a5-44bc-bd73-b1a3b12f4437 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-84dafc05-683b-40bb-9b2e-c829f36c143e-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Group snapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: creating. {{(pid=94234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Creating offline snapshot d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf of volume 942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bb68b-ddf4-441f-a12f-51e1353f6fa0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-c055d604-6424-4e18-990e-aa5d49815927-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-c055d604-6424-4e18-990e-aa5d49815927-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:11 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c Aug 20 06:41:11 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c7317-d63d-43c7-8694-f984952b6c91]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:11 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:41:11 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:12 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c" returned: 0 in 0.488s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:12 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf 1G Aug 20 06:41:12 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:12 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:12 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927 Aug 20 06:41:12 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:12 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c055d604-6424-4e18-990e-aa5d49815927" returned: 0 in 0.310s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-c055d604-6424-4e18-990e-aa5d49815927" released by "delete_volume" :: held 0.846s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf 1G" returned: 0 in 0.577s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942b1f7e-a71a-4104-926b-59f99a06480c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:12 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:12 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942b1f7e-a71a-4104-926b-59f99a06480c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf Aug 20 06:41:12 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['57ec3e17-c49a-4009-ab82-2b5d5685b994', '493ed039-c8f6-414e-a027-e60ee71b168d', 'b4cf4176-af9a-4e36-be37-4d0b484f2767', 'ddfad9e8-8c9c-4b4e-878d-4b923c4ff2ff'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:12 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:12 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:13 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.324s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Deleted volume successfully. Aug 20 06:41:13 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942b1f7e-a71a-4104-926b-59f99a06480c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" returned: 0 in 0.646s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:13 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c27ea6f2-0673-42e0-80f3-404c987fb84d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-c055d604-6424-4e18-990e-aa5d49815927-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:13 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf Aug 20 06:41:13 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:13 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" returned: 0 in 0.303s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:13 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info Aug 20 06:41:13 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (600b494d-20b4-4eb9-a51d-8a997aae5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b5922-7eb4-4399-a720-a33af7dd6bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b5922-7eb4-4399-a720-a33af7dd6bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-927500989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026b898a-6441-4abf-9adb-ef05f2d3d437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:14Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7362c5f-d5e6-417c-8067-d1f2a35e9224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7362c5f-d5e6-417c-8067-d1f2a35e9224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8372fc9f-c950-412b-81f1-a2209a9acbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8372fc9f-c950-412b-81f1-a2209a9acbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026b898a-6441-4abf-9adb-ef05f2d3d437', 'volume_name': 'volume-026b898a-6441-4abf-9adb-ef05f2d3d437', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:13 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82919c-976d-4204-ab3b-18dae935326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82919c-976d-4204-ab3b-18dae935326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac821586-c2de-4b8d-b9aa-5bb7cf1f3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Volume 026b898a-6441-4abf-9adb-ef05f2d3d437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026b898a-6441-4abf-9adb-ef05f2d3d437', 'volume_size': 1} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info" returned: 0 in 0.300s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:13 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:41:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:13 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info Aug 20 06:41:13 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:14 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.info" returned: 0 in 0.261s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-927500989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026b898a-6441-4abf-9adb-ef05f2d3d437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:14Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Creating volume 026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:41:14 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:14 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 1073741824 Aug 20 06:41:14 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7030c890-580a-491b-976d-a091eb4c9fb5 tempest-GroupSnapshotsV319Test-1112490374 None] group_snapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: created successfully Aug 20 06:41:14 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 1073741824" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:14 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:14 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:14 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.292s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac821586-c2de-4b8d-b9aa-5bb7cf1f3b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026b898a-6441-4abf-9adb-ef05f2d3d437', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4946fb-e355-4988-8851-c5bcc0e9f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Volume volume-026b898a-6441-4abf-9adb-ef05f2d3d437 (026b898a-6441-4abf-9adb-ef05f2d3d437): created successfully Aug 20 06:41:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4946fb-e355-4988-8851-c5bcc0e9f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (600b494d-20b4-4eb9-a51d-8a997aae5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2456d83e-b2ff-4d07-a8a3-321b7ce2e7e4 tempest-VolumesSnapshotTestJSON-87972829 None] Created volume successfully. Aug 20 06:41:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] group_snapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: deleting Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] group_snapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: deleting {{(pid=94234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "cinder-quobyte-d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Deleting offline snapshot d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf of volume 942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] snapshot_file for this snap is: volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac25f6-83de-45a6-b254-b1c757c88338]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:15 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf Aug 20 06:41:15 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:15 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" returned: 0 in 0.444s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-942b1f7e-a71a-4104-926b-59f99a06480c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fee8f3-58e3-437b-95bf-b16aa47ee1e5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:16 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c Aug 20 06:41:16 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Creating offline snapshot 10f69e28-d22b-4da1-bfea-0c472be7d157 of volume 026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[29257e92-93ef-4fa0-aa03-6f0978b649bc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:16 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c" returned: 0 in 0.808s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:16 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf Aug 20 06:41:16 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:16 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:16 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:17 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.683s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:17 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 1G Aug 20 06:41:17 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:17 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" returned: 0 in 0.687s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:17 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf Aug 20 06:41:17 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:17 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c.d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-d31be73e-ae69-4d44-8baf-3a3a0a5b1fbf" released by "_delete_snapshot" :: held 2.469s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" released by "delete_snapshot" :: held 2.503s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:17 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 1G" returned: 0 in 0.581s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-026b898a-6441-4abf-9adb-ef05f2d3d437 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:17 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-026b898a-6441-4abf-9adb-ef05f2d3d437 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:17 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:17 devstack cinder-volume[94234]: WARNING cinder.quota [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1958934507 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1958934507, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:41:17 devstack cinder-volume[94234]: WARNING cinder.quota [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1958934507 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1958934507, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:41:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] Created reservations ['821efd9e-e67d-4b00-bb2d-a72356b330e0', 'aea6f933-4c5f-4eac-9bd2-10baec08451c', 'e5e135d6-4b3e-4e0c-a1e9-fc73b6efc685', 'b8f9524e-4f51-4390-ae88-91eb7cbc3712'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cf2abd4b-27ba-426b-94a7-a71c0d9fa45d tempest-GroupSnapshotsV319Test-1112490374 None] group_snapshot 9393440f-9cc4-407c-9bf7-d5ffd255f2fe: deleted successfully Aug 20 06:41:18 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-026b898a-6441-4abf-9adb-ef05f2d3d437 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.359s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 is being set with open permissions: ugo+rw Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:18 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:18 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:18 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.275s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:18 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info Aug 20 06:41:18 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:18 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info is being set with open permissions: ugo+rw Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:18 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info Aug 20 06:41:18 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16887e9-3beb-4a8f-b9bd-9af4b36486f3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:19 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.info" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef1adcd4-bf04-4535-abc9-ef85676e0ebb tempest-VolumesSnapshotTestJSON-87972829 None] Create snapshot completed successfully Aug 20 06:41:19 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c Aug 20 06:41:19 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:19 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c" returned: 0 in 0.398s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:19 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c Aug 20 06:41:19 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:19 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-942b1f7e-a71a-4104-926b-59f99a06480c" returned: 0 in 0.254s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "cinder-quobyte-942b1f7e-a71a-4104-926b-59f99a06480c" released by "delete_volume" :: held 0.733s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Created reservations ['853c57ba-923f-407d-9c06-1a1fe35498cd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:19 devstack cinder-volume[94234]: WARNING cinder.quota [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1958934507 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1958934507, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Created reservations ['ee45f2af-2405-4e19-9579-a502faedbac5', 'c772ac09-c493-4496-b841-180baa240a5c', '47a6d8b9-16cb-4367-953e-310e5916b069', 'cf73aa03-9add-4629-82a7-5031da028a84'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:19 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:19 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (472c7cc7-64ec-4276-b46e-08c82315093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59776b-a30d-4b2a-90bf-6bb3cc0f6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59776b-a30d-4b2a-90bf-6bb3cc0f6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-38559445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8d7534-0d33-4614-bbb3-d02ff3acce6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee344ea458f4e4b87404caf057f493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10f69e28-d22b-4da1-bfea-0c472be7d157,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:20Z,use_quota=True,user_id='58ec623525ed4235a4786d6b1c45050f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a2fd9-0d31-4845-8734-4277876e5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a2fd9-0d31-4845-8734-4277876e5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b757b573-60ab-4fda-becd-6d031ded30b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b757b573-60ab-4fda-becd-6d031ded30b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf8d7534-0d33-4614-bbb3-d02ff3acce6b', 'volume_name': 'volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b', 'volume_size': 1, 'snapshot_id': '10f69e28-d22b-4da1-bfea-0c472be7d157'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398ccbc3-5c89-4801-98c2-aeae93b48c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398ccbc3-5c89-4801-98c2-aeae93b48c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6371b668-f742-4787-a5ad-32565bf50f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Volume cf8d7534-0d33-4614-bbb3-d02ff3acce6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b', 'volume_size': 1, 'snapshot_id': '10f69e28-d22b-4da1-bfea-0c472be7d157'} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Creating volume cf8d7534-0d33-4614-bbb3-d02ff3acce6b from snapshot 10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:20 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.319s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3948194d-4b16-4cbf-a222-cea4d19c7415 tempest-GroupSnapshotsV319Test-1112490374 None] Delete group completed successfully. Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] snapshot: 10f69e28-d22b-4da1-bfea-0c472be7d157, volume: cf8d7534-0d33-4614-bbb3-d02ff3acce6b, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4a3ed4-cd34-40a7-8861-5155a5d20935]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:20 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:20 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:20 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.449s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-026b898a-6441-4abf-9adb-ef05f2d3d437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0a4c5-3e50-4c95-af01-099932a3f097]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:20 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:20 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:21 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.422s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:41:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:41:21 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:41:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:21 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b Aug 20 06:41:21 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:27 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" returned: 0 in 6.379s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:41:27 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Converted 1024.00 MB image at 160.47 MB/s Aug 20 06:41:27 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b is being set with open permissions: ugo+rw Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:27 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b Aug 20 06:41:27 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:27 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" released by "_copy_volume_from_snapshot" :: held 7.639s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" released by "_create_volume_from_snapshot" :: held 7.726s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.744s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6371b668-f742-4787-a5ad-32565bf50f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b', 'volume_size': 1, 'snapshot_id': '10f69e28-d22b-4da1-bfea-0c472be7d157'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90655543-cadc-4a84-ba31-9196500655d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:27 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Volume volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b (cf8d7534-0d33-4614-bbb3-d02ff3acce6b): created successfully Aug 20 06:41:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90655543-cadc-4a84-ba31-9196500655d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Flow 'volume_create_manager' (472c7cc7-64ec-4276-b46e-08c82315093d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-48d30432-1b41-4826-afed-8fec4dee374d tempest-VolumesSnapshotTestJSON-87972829 None] Created volume successfully. Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-cf8d7534-0d33-4614-bbb3-d02ff3acce6b-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-cf8d7534-0d33-4614-bbb3-d02ff3acce6b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e19a0-ba7d-42b9-9f1c-27f2f7864021]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:28 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b Aug 20 06:41:28 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (b9e3110b-5a66-4e26-9de9-f0157e3782a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766cf352-fb4c-4fef-90f5-5ee500908e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766cf352-fb4c-4fef-90f5-5ee500908e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230621127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbb5cd8-8691-492d-a16c-42c8c9c390c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:29Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d805b45-6845-4542-a58a-eceda21ce268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d805b45-6845-4542-a58a-eceda21ce268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9591837-7eb0-48fc-8979-c6dc93dd6011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9591837-7eb0-48fc-8979-c6dc93dd6011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbb5cd8-8691-492d-a16c-42c8c9c390c4', 'volume_name': 'volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddb6d05-b3f7-471b-acc7-8895c62f4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddb6d05-b3f7-471b-acc7-8895c62f4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93b915e-20f7-4fe3-93c4-dd5a1d1cb6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Volume ddbb5cd8-8691-492d-a16c-42c8c9c390c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4', 'volume_size': 1} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230621127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbb5cd8-8691-492d-a16c-42c8c9c390c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:29Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Creating volume ddbb5cd8-8691-492d-a16c-42c8c9c390c4 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:41:28 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:41:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:29 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 1073741824 Aug 20 06:41:29 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:29 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" returned: 0 in 0.560s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:29 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b Aug 20 06:41:29 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:29 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-cf8d7534-0d33-4614-bbb3-d02ff3acce6b" released by "delete_volume" :: held 1.001s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:29 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 1073741824" returned: 0 in 0.573s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['d36a56ae-8f71-484f-8d56-04768bc9ecc0', 'eeae92bd-85dc-4d33-a93a-b6dfaf27314c', '0830122b-5a33-461c-a34a-ac056de6922a', '5d770ae6-61aa-4a67-9628-c8861de4ad5d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:29 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 Aug 20 06:41:29 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:29 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:29 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:30 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" returned: 0 in 0.501s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93b915e-20f7-4fe3-93c4-dd5a1d1cb6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df695555-d310-4281-a16b-c76de34b8bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:30 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Volume volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 (ddbb5cd8-8691-492d-a16c-42c8c9c390c4): created successfully Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df695555-d310-4281-a16b-c76de34b8bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (b9e3110b-5a66-4e26-9de9-f0157e3782a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-72c6dbdd-4fd4-4bcd-94fd-b1d07b8a27c8 tempest-AttachVolumeNegativeTest-1918186608 None] Created volume successfully. Aug 20 06:41:30 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.447s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Deleted volume successfully. Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f402c91e-1ace-41e5-a124-ba00f1800b0b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-cf8d7534-0d33-4614-bbb3-d02ff3acce6b-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-10f69e28-d22b-4da1-bfea-0c472be7d157-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-10f69e28-d22b-4da1-bfea-0c472be7d157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Deleting offline snapshot 10f69e28-d22b-4da1-bfea-0c472be7d157 of volume 026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] snapshot_file for this snap is: volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[714019b3-d393-4192-bd86-e049a6e7111c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:30 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:30 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6b03ee99-9bc3-4f38-b8a8-369363ca0185 tempest-GroupsV320Test-754865975 None] Group tempest-GroupsV320Test-Group-296556067: creating Aug 20 06:41:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6b03ee99-9bc3-4f38-b8a8-369363ca0185 tempest-GroupsV320Test-754865975 None] Group tempest-GroupsV320Test-Group-296556067: created successfully Aug 20 06:41:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6b03ee99-9bc3-4f38-b8a8-369363ca0185 tempest-GroupsV320Test-754865975 None] Create group completed successfully. Aug 20 06:41:31 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.497s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-026b898a-6441-4abf-9adb-ef05f2d3d437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[10feeb57-946b-46c9-af95-5ab18423148b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:31 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:31 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-df9aa97c-87dc-4826-976c-de5492a0ab96 req-6a6e8398-4ad5-4cda-b3af-367debd33579 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-df9aa97c-87dc-4826-976c-de5492a0ab96 req-6a6e8398-4ad5-4cda-b3af-367debd33579 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-df9aa97c-87dc-4826-976c-de5492a0ab96 req-6a6e8398-4ad5-4cda-b3af-367debd33579 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-df9aa97c-87dc-4826-976c-de5492a0ab96 req-6a6e8398-4ad5-4cda-b3af-367debd33579 tempest-AttachVolumeNegativeTest-1918186608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93157e54-8421-4507-9cfc-3309f31ce84c', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:41:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-df9aa97c-87dc-4826-976c-de5492a0ab96 req-6a6e8398-4ad5-4cda-b3af-367debd33579 tempest-AttachVolumeNegativeTest-1918186608 None] attachment_update completed successfully. Aug 20 06:41:32 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.698s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:32 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:32 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:32 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:32 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157 Aug 20 06:41:32 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:33 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437.10f69e28-d22b-4da1-bfea-0c472be7d157" returned: 0 in 0.562s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-10f69e28-d22b-4da1-bfea-0c472be7d157" released by "_delete_snapshot" :: held 2.428s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" released by "delete_snapshot" :: held 2.478s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Created reservations ['16e991ef-32fb-45b1-9756-0d7b88bf7fde'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:33 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:33 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['6490520c-4216-4af5-a7dd-1eecb5a74e5d', '3bbc4e35-036c-47a9-b248-3d507f22dbf1', '61914d82-9968-43dd-9ee2-30cd2c9f4056', 'c43273ff-d7ba-4973-ada2-24dbec0517c9'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Delete snapshot completed successfully. Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f7454877-b018-406a-b44b-3cc4caf0a0b4 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-10f69e28-d22b-4da1-bfea-0c472be7d157-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:33 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.447s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:33 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f0028137-8fb5-4312-9013-a039ef6f594d tempest-GroupsV320Test-754865975 None] Delete group completed successfully. Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-026b898a-6441-4abf-9adb-ef05f2d3d437-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-026b898a-6441-4abf-9adb-ef05f2d3d437-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:34 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:34 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f62ee5-3d88-4363-8949-d00a8c9f0bc3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:34 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:34 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:34 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.506s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:41:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:41:35 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.631s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:35 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437 Aug 20 06:41:35 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:35 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-026b898a-6441-4abf-9adb-ef05f2d3d437" returned: 0 in 0.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-026b898a-6441-4abf-9adb-ef05f2d3d437" released by "delete_volume" :: held 1.115s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['29b0f565-51ab-4379-8c0d-a7cadd02002e', 'd6e41b3a-3425-4507-abec-5c0f511ba27c', '19363afc-23b7-4cf7-9baa-793fbb32a1f3', 'a1a4c0df-2229-41ca-8ea8-e6e8d5525e3c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:35 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:35 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-68632d2e-9b6a-499a-8f30-1ae22c89b636 req-4ed0b518-9448-42a3-a6a3-1cd0a1d6c132 tempest-AttachVolumeNegativeTest-1918186608 None] Terminate volume connection completed successfully. Aug 20 06:41:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-68632d2e-9b6a-499a-8f30-1ae22c89b636 req-4ed0b518-9448-42a3-a6a3-1cd0a1d6c132 tempest-AttachVolumeNegativeTest-1918186608 None] Deleting attachment 93157e54-8421-4507-9cfc-3309f31ce84c. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:41:36 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.669s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Deleted volume successfully. Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2445d1b9-6e0a-426a-a567-bc5d9f5b4fc2 tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-026b898a-6441-4abf-9adb-ef05f2d3d437-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-6d91c511-c20a-4129-bf33-98a78a3cddee-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-6d91c511-c20a-4129-bf33-98a78a3cddee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d94cbb-e373-4291-9d79-06ff8ff37891]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:37 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee Aug 20 06:41:37 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:37 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee" returned: 0 in 0.534s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:37 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee Aug 20 06:41:37 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:38 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d91c511-c20a-4129-bf33-98a78a3cddee" returned: 0 in 0.606s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-quobyte-6d91c511-c20a-4129-bf33-98a78a3cddee" released by "delete_volume" :: held 1.284s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Created reservations ['7310ee1d-7546-43b2-9ac5-296e57da5316', '89f670b3-2389-45c1-a7d8-9efba1aca229', '01f28f54-1c83-4f03-be0b-2b55019ec01a', '862d73f9-dbb7-4bae-9e40-1aa84fe4a976'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:38 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:41:38 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:39 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.633s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:39 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:41:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Deleted volume successfully. Aug 20 06:41:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1ecdb53-98dc-414c-8728-5dc616ac9d2b tempest-VolumesSnapshotTestJSON-87972829 None] Lock "cinder-6d91c511-c20a-4129-bf33-98a78a3cddee-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Flow 'volume_create_manager' (2249c4c3-4250-43e1-ab0d-1e8771840b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007ca70e-dadb-46ae-a330-1e988f881601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007ca70e-dadb-46ae-a330-1e988f881601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-309022651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc4aa75-40aa-4ac4-8384-90c932002d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c00913782ef48979871c03434caf4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:43Z,use_quota=True,user_id='b510cc2c730c46c4adea2fda89dfd568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcc0fb6-7f8c-4077-8e98-43eb9f778b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcc0fb6-7f8c-4077-8e98-43eb9f778b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e994bef-f310-45a6-9c2f-3e5929289ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e994bef-f310-45a6-9c2f-3e5929289ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc4aa75-40aa-4ac4-8384-90c932002d2c', 'volume_name': 'volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0867202e-e555-46b3-97fd-e5db242006dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0867202e-e555-46b3-97fd-e5db242006dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0630534f-6618-4b12-b83e-cf7aacb71ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Volume bdc4aa75-40aa-4ac4-8384-90c932002d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c', 'volume_size': 1} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-309022651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc4aa75-40aa-4ac4-8384-90c932002d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c00913782ef48979871c03434caf4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:41:43Z,use_quota=True,user_id='b510cc2c730c46c4adea2fda89dfd568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Creating volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:41:43 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:41:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:43 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c 1073741824 Aug 20 06:41:43 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:44 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c 1073741824" returned: 0 in 0.668s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:44 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c Aug 20 06:41:44 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:44 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0630534f-6618-4b12-b83e-cf7aacb71ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b04789e-f921-4455-82e2-744d6d5ac8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:41:44 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Volume volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c (bdc4aa75-40aa-4ac4-8384-90c932002d2c): created successfully Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b04789e-f921-4455-82e2-744d6d5ac8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:41:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Flow 'volume_create_manager' (2249c4c3-4250-43e1-ab0d-1e8771840b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:41:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-43891904-1ff1-4588-b8b7-9d90f30941cd tempest-SnapshotsActionsTest-792870485 None] Created volume successfully. Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Creating offline snapshot f0b4c1f4-17f8-4df5-85cf-3241af5f741b of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bb8840-7fd1-460f-b395-4cc061aa3d3b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:46 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c Aug 20 06:41:46 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:46 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c" returned: 0 in 0.594s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:46 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b 1G Aug 20 06:41:46 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:47 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b 1G" returned: 0 in 0.738s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:47 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:41:47 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:47 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.421s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b is being set with open permissions: ugo+rw Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:48 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:41:48 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:48 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.409s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:48 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info Aug 20 06:41:48 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:48 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info is being set with open permissions: ugo+rw Aug 20 06:41:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:48 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info Aug 20 06:41:48 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:49 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.info" returned: 0 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0f6e4227-a709-4ad3-9d81-f705515e102c tempest-SnapshotsActionsTest-792870485 None] Create snapshot completed successfully Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Creating offline snapshot c6668334-dcbe-443d-be2b-752358185620 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0bdf88-9896-4131-93db-8cc55ee54169]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:50 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:41:50 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:50 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.466s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:50 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 1G Aug 20 06:41:50 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:51 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 1G" returned: 0 in 0.588s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:51 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 Aug 20 06:41:51 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:51 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620" returned: 0 in 0.489s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:51 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 is being set with open permissions: ugo+rw Aug 20 06:41:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:51 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 Aug 20 06:41:51 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:51 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3a6bf1cf-f68e-4cd4-adae-39dc903bc609 tempest-SnapshotsActionsTest-792870485 None] Create snapshot completed successfully Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-c6668334-dcbe-443d-be2b-752358185620-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-c6668334-dcbe-443d-be2b-752358185620-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-c6668334-dcbe-443d-be2b-752358185620" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-c6668334-dcbe-443d-be2b-752358185620" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Deleting offline snapshot c6668334-dcbe-443d-be2b-752358185620 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] snapshot_file for this snap is: volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b44e4-565b-4d29-8226-4289d6e22ebd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:52 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 Aug 20 06:41:52 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:52 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620" returned: 0 in 0.423s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b6a42-52e0-41de-a9d0-be0cf3ed13d8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:53 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:41:53 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:53 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.402s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:53 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 Aug 20 06:41:53 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:53 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620" returned: 0 in 0.615s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:53 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620 Aug 20 06:41:53 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:54 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.c6668334-dcbe-443d-be2b-752358185620" returned: 0 in 0.462s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-c6668334-dcbe-443d-be2b-752358185620" released by "_delete_snapshot" :: held 2.039s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_snapshot" :: held 2.081s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Created reservations ['c052a4f1-1b20-4bfc-83a3-2b95b286933c', '724bcd74-2f4e-463c-9bfb-eac53471a984', 'e9052528-8560-4d41-a951-cded12607dac', '4ec4e895-ef72-46a3-afc5-24cf52fef743'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:41:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Delete snapshot completed successfully. Aug 20 06:41:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e798ff63-0ccc-414c-935d-c8500530cf95 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-c6668334-dcbe-443d-be2b-752358185620-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:41:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:41:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:41:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Creating offline snapshot e2a5d189-bcd0-4ba0-b9df-782057177b9f of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:41:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130603d-9bd4-44df-970b-483b49dba728]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:56 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:41:56 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:56 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.880s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:41:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:57 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f 1G Aug 20 06:41:57 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:57 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f 1G" returned: 0 in 0.846s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:57 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f Aug 20 06:41:57 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:58 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f" returned: 0 in 0.753s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:58 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f is being set with open permissions: ugo+rw Aug 20 06:41:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:41:58 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f Aug 20 06:41:58 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:41:58 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 20 06:41:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f" returned: 0 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.098s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:41:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-afe0c789-09c6-41d3-94bd-5af160f53338 tempest-SnapshotsActionsTest-792870485 None] Create snapshot completed successfully Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-e2a5d189-bcd0-4ba0-b9df-782057177b9f-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-e2a5d189-bcd0-4ba0-b9df-782057177b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_snapshot" :: waited 0.069s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-e2a5d189-bcd0-4ba0-b9df-782057177b9f" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-e2a5d189-bcd0-4ba0-b9df-782057177b9f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Deleting offline snapshot e2a5d189-bcd0-4ba0-b9df-782057177b9f of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] snapshot_file for this snap is: volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699af8b-a5a3-482e-ab23-8c85eb4eee3e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:41:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:00 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f Aug 20 06:42:00 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:00 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f" returned: 0 in 0.659s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[87640b93-986d-4658-8d2d-ca204cb8b754]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:00 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:00 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:01 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.776s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:01 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f Aug 20 06:42:01 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (5254411f-9073-42cc-bfe6-49be8b5b52cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0cd9a3-0c4d-45db-9817-cc155693716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0cd9a3-0c4d-45db-9817-cc155693716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-760183040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c6c90-b907-4e14-8f20-53b159e37c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:02Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede20c90-7cdb-46b4-980d-144fcd2d7442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede20c90-7cdb-46b4-980d-144fcd2d7442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fa485e-4dca-4c95-8c9d-44279f60c917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fa485e-4dca-4c95-8c9d-44279f60c917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319c6c90-b907-4e14-8f20-53b159e37c44', 'volume_name': 'volume-319c6c90-b907-4e14-8f20-53b159e37c44', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5712a18d-e0cb-4dc8-9c9f-e06b3cbcad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5712a18d-e0cb-4dc8-9c9f-e06b3cbcad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9daaeb-9475-475b-9495-c99607b06c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:01 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Volume 319c6c90-b907-4e14-8f20-53b159e37c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319c6c90-b907-4e14-8f20-53b159e37c44', 'volume_size': 1} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-760183040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c6c90-b907-4e14-8f20-53b159e37c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:02Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Creating volume 319c6c90-b907-4e14-8f20-53b159e37c44 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:01 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:01 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 1073741824 Aug 20 06:42:01 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:02 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f" returned: 0 in 0.878s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:02 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f Aug 20 06:42:02 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:02 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.e2a5d189-bcd0-4ba0-b9df-782057177b9f" returned: 0 in 0.351s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-e2a5d189-bcd0-4ba0-b9df-782057177b9f" released by "_delete_snapshot" :: held 2.900s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_snapshot" :: held 2.950s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:02 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 1073741824" returned: 0 in 0.930s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:02 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Created reservations ['0d872bab-907c-4d08-b50c-ab1d7c1c82c1', 'efbef4d4-5d6b-4c44-81be-4bc48f0339d4', '63279e26-36d3-4280-bc87-2412292f0af0', 'a3534c1a-1211-4989-b675-957cf41e83a7'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:02 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 Aug 20 06:42:02 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Delete snapshot completed successfully. Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a390c870-40bc-4b6c-b583-21fbd4d30832 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-e2a5d189-bcd0-4ba0-b9df-782057177b9f-delete_snapshot" released by "delete_snapshot" :: held 3.400s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:03 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44" returned: 0 in 0.840s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9daaeb-9475-475b-9495-c99607b06c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319c6c90-b907-4e14-8f20-53b159e37c44', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6376eee-b5bd-41d9-9e4b-a5f6706ab5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Creating offline snapshot 359f4e83-f4ee-49d6-8fa5-330d04e99739 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:42:03 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Volume volume-319c6c90-b907-4e14-8f20-53b159e37c44 (319c6c90-b907-4e14-8f20-53b159e37c44): created successfully Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6376eee-b5bd-41d9-9e4b-a5f6706ab5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (5254411f-9073-42cc-bfe6-49be8b5b52cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9740f8-c84d-42f2-89a6-067ac9fef4dd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f89a163b-0626-4c27-ba20-9ce5a5864ba7 tempest-AttachVolumeTestJSON-1774153121 None] Created volume successfully. Aug 20 06:42:04 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:04 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:04 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.771s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:04 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 1G Aug 20 06:42:04 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:05 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 1G" returned: 0 in 0.698s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:05 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 Aug 20 06:42:05 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:05 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739" returned: 0 in 0.521s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:05 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 is being set with open permissions: ugo+rw Aug 20 06:42:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:05 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 Aug 20 06:42:05 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43e98749-7154-4891-a85c-cb9af45e363f req-d52466d1-9124-43cc-a0f3-80521f36b05a tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:06 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739" returned: 0 in 0.306s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43e98749-7154-4891-a85c-cb9af45e363f req-d52466d1-9124-43cc-a0f3-80521f36b05a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.187s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43e98749-7154-4891-a85c-cb9af45e363f req-d52466d1-9124-43cc-a0f3-80521f36b05a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ebe39725-8eb8-43ac-90f2-35c494d4fe65 tempest-SnapshotsActionsTest-792870485 None] Create snapshot completed successfully Aug 20 06:42:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-43e98749-7154-4891-a85c-cb9af45e363f req-d52466d1-9124-43cc-a0f3-80521f36b05a tempest-AttachVolumeTestJSON-1774153121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-319c6c90-b907-4e14-8f20-53b159e37c44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d5436b8-4a81-4486-8f2f-a69f1ee35182', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:42:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-43e98749-7154-4891-a85c-cb9af45e363f req-d52466d1-9124-43cc-a0f3-80521f36b05a tempest-AttachVolumeTestJSON-1774153121 None] attachment_update completed successfully. Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-359f4e83-f4ee-49d6-8fa5-330d04e99739-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-359f4e83-f4ee-49d6-8fa5-330d04e99739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-359f4e83-f4ee-49d6-8fa5-330d04e99739" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-359f4e83-f4ee-49d6-8fa5-330d04e99739" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Deleting offline snapshot 359f4e83-f4ee-49d6-8fa5-330d04e99739 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] snapshot_file for this snap is: volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5709ac4-31f2-4af5-94b6-4b78164c26ea]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:07 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 Aug 20 06:42:07 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:07 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739" returned: 0 in 0.654s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f3dcf-bc62-46b2-9f99-1c6dc2a5ebe2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:08 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:08 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:08 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.546s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:08 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 Aug 20 06:42:08 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=122,cinder:SELECT=119,cinder:DELETE=10,cinder:INSERT=30 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=118,cinder:INSERT=26,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:09 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (41c7c464-5f60-4c4b-b029-7154e0d112fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf19339-85cb-4c14-a5b9-3fe9dfad89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739" returned: 0 in 0.577s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf19339-85cb-4c14-a5b9-3fe9dfad89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1717140304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b90a9b-3521-4874-ae05-3690cf293864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:09Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:09 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739 Aug 20 06:42:09 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bfa8d6-5467-40ff-9dbc-00acbb5c3f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bfa8d6-5467-40ff-9dbc-00acbb5c3f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b270ffbe-8a70-4389-8acd-a9aa250842ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b270ffbe-8a70-4389-8acd-a9aa250842ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b90a9b-3521-4874-ae05-3690cf293864', 'volume_name': 'volume-c2b90a9b-3521-4874-ae05-3690cf293864', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b49a0c1-ad47-4351-9a45-33d47ac80bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b49a0c1-ad47-4351-9a45-33d47ac80bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ecdb3e-1cbb-4f97-9711-fdc50c832c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Volume c2b90a9b-3521-4874-ae05-3690cf293864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b90a9b-3521-4874-ae05-3690cf293864', 'volume_size': 1} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1717140304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b90a9b-3521-4874-ae05-3690cf293864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a551e02b52b346898aa7165e46d79063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:09Z,use_quota=True,user_id='c861c2016aba40e78508d33af744d829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Creating volume c2b90a9b-3521-4874-ae05-3690cf293864 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:09 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 1073741824 Aug 20 06:42:09 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:09 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.359f4e83-f4ee-49d6-8fa5-330d04e99739" returned: 0 in 0.333s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-359f4e83-f4ee-49d6-8fa5-330d04e99739" released by "_delete_snapshot" :: held 2.277s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_snapshot" :: held 2.320s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Created reservations ['a2803259-9789-4dcc-bae2-63ccf4b9e0a1', '73891bae-66e5-4a36-9432-59575414a800', 'e55c78b0-b051-400f-b2a7-14ce2b4422df', 'ae04793f-94b8-4e35-856b-ffd968890da4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Delete snapshot completed successfully. Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-40a8f9fd-c136-4cd0-b8d9-85d7b629ee02 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-359f4e83-f4ee-49d6-8fa5-330d04e99739-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:09 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 1073741824" returned: 0 in 0.585s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:09 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 Aug 20 06:42:09 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:10 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ecdb3e-1cbb-4f97-9711-fdc50c832c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b90a9b-3521-4874-ae05-3690cf293864', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883f568d-8afd-47a5-88bf-c8776c518782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Volume volume-c2b90a9b-3521-4874-ae05-3690cf293864 (c2b90a9b-3521-4874-ae05-3690cf293864): created successfully Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883f568d-8afd-47a5-88bf-c8776c518782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Flow 'volume_create_manager' (41c7c464-5f60-4c4b-b029-7154e0d112fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0d97c3e4-ebbb-48f2-944c-9886c58bcf87 tempest-AttachVolumeTestJSON-1774153121 None] Created volume successfully. Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Creating offline snapshot 39162243-6152-4ef7-b948-e18ce12f3ce2 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15f1a4d-505b-4f5d-8151-1a7b205b6c0a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:10 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:10 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:11 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.522s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:11 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 1G Aug 20 06:42:11 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:11 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 1G" returned: 0 in 0.607s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:11 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 Aug 20 06:42:11 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6bd2e302-9d0a-4992-ae63-794f89d69c9e req-000a2c68-d6e0-4019-b086-cd7ee12bd95a tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:12 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2" returned: 0 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:12 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 is being set with open permissions: ugo+rw Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:12 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 Aug 20 06:42:12 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:12 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2" returned: 0 in 0.276s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6bd2e302-9d0a-4992-ae63-794f89d69c9e req-000a2c68-d6e0-4019-b086-cd7ee12bd95a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.488s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-6bd2e302-9d0a-4992-ae63-794f89d69c9e req-000a2c68-d6e0-4019-b086-cd7ee12bd95a tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d7237305-b052-427b-aa0b-b5e4374170b6 tempest-SnapshotsActionsTest-792870485 None] Create snapshot completed successfully Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-6bd2e302-9d0a-4992-ae63-794f89d69c9e req-000a2c68-d6e0-4019-b086-cd7ee12bd95a tempest-AttachVolumeTestJSON-1774153121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-c2b90a9b-3521-4874-ae05-3690cf293864', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f0268e2-7735-4f9f-aa66-a5cff6a70687', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:42:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-6bd2e302-9d0a-4992-ae63-794f89d69c9e req-000a2c68-d6e0-4019-b086-cd7ee12bd95a tempest-AttachVolumeTestJSON-1774153121 None] attachment_update completed successfully. Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-39162243-6152-4ef7-b948-e18ce12f3ce2-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-39162243-6152-4ef7-b948-e18ce12f3ce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Acquiring lock "cinder-quobyte-39162243-6152-4ef7-b948-e18ce12f3ce2" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-39162243-6152-4ef7-b948-e18ce12f3ce2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Deleting offline snapshot 39162243-6152-4ef7-b948-e18ce12f3ce2 of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] snapshot_file for this snap is: volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca87d7-2bc1-408a-a8c5-60ae5deac8cb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:13 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 Aug 20 06:42:13 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:13 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2" returned: 0 in 0.475s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded45580-b18e-4546-b60e-a33888a18167]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:13 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:13 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:14 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.436s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:14 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 Aug 20 06:42:14 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:14 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2" returned: 0 in 0.498s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:14 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2 Aug 20 06:42:14 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:14 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.39162243-6152-4ef7-b948-e18ce12f3ce2" returned: 0 in 0.269s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-39162243-6152-4ef7-b948-e18ce12f3ce2" released by "_delete_snapshot" :: held 1.821s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_snapshot" :: held 1.854s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:14 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Created reservations ['309112ea-b70c-41b1-b88e-b605c6f50676', '39317b36-d6b1-4299-89c4-6e6705cd428a', '65b368ef-49cf-4dcb-88cd-b214a1d20a01', 'af864d30-a57a-4d43-8489-d851bd8d6eb2'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Delete snapshot completed successfully. Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6d4273da-a15b-4631-85a2-d65c9ae64856 tempest-SnapshotsActionsTest-1114446815 None] Lock "cinder-39162243-6152-4ef7-b948-e18ce12f3ce2-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-a1cbdc99-76bf-4b7d-b6df-cee69c621408 req-f81ec0be-af3d-454e-88fe-f6868239ce6d tempest-AttachVolumeTestJSON-1774153121 None] Terminate volume connection completed successfully. Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-a1cbdc99-76bf-4b7d-b6df-cee69c621408 req-f81ec0be-af3d-454e-88fe-f6868239ce6d tempest-AttachVolumeTestJSON-1774153121 None] Deleting attachment 1d5436b8-4a81-4486-8f2f-a69f1ee35182. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "cinder-f0b4c1f4-17f8-4df5-85cf-3241af5f741b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-f0b4c1f4-17f8-4df5-85cf-3241af5f741b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "cinder-quobyte-f0b4c1f4-17f8-4df5-85cf-3241af5f741b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-f0b4c1f4-17f8-4df5-85cf-3241af5f741b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Deleting offline snapshot f0b4c1f4-17f8-4df5-85cf-3241af5f741b of volume bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] snapshot_file for this snap is: volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598da18-5b18-45d2-b622-7e51723474d6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:16 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:16 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:16 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.500s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa69069-e63b-48ca-a54d-e1ab656511d9]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:16 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c Aug 20 06:42:16 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-0568771f-0604-45b2-9c28-934a1471655e req-b2c729f6-810f-4f48-b0a6-610c8a479a43 tempest-AttachVolumeTestJSON-1774153121 None] Terminate volume connection completed successfully. Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-0568771f-0604-45b2-9c28-934a1471655e req-b2c729f6-810f-4f48-b0a6-610c8a479a43 tempest-AttachVolumeTestJSON-1774153121 None] Deleting attachment 8f0268e2-7735-4f9f-aa66-a5cff6a70687. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:42:16 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c" returned: 0 in 0.553s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:16 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:16 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:17 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.493s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:17 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b Aug 20 06:42:17 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:17 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c.f0b4c1f4-17f8-4df5-85cf-3241af5f741b" returned: 0 in 0.399s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-f0b4c1f4-17f8-4df5-85cf-3241af5f741b" released by "_delete_snapshot" :: held 2.111s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_snapshot" :: held 2.152s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:18 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Created reservations ['4d02fa0e-5743-49b7-82e7-933bd3c25cef', '4072acd6-2ea8-43ed-ba19-92d06e8d1717', '2a740483-d4fd-4a64-9098-a11608e5279d', '3b6ed2ac-3c8b-40a5-b8a1-5d2ada7f3998'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:18 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Delete snapshot completed successfully. Aug 20 06:42:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-709228ee-0065-47cd-b5aa-7d78dbd93ccc tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-f0b4c1f4-17f8-4df5-85cf-3241af5f741b-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "cinder-bdc4aa75-40aa-4ac4-8384-90c932002d2c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-bdc4aa75-40aa-4ac4-8384-90c932002d2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1563df29-e4a5-4487-b529-1f55ec193841]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:19 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c Aug 20 06:42:19 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:19 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c" returned: 0 in 0.505s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:19 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c Aug 20 06:42:19 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:20 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bdc4aa75-40aa-4ac4-8384-90c932002d2c" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-quobyte-bdc4aa75-40aa-4ac4-8384-90c932002d2c" released by "delete_volume" :: held 0.911s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Created reservations ['04089f67-d044-4fe7-87a5-6cfd1c1c5f81', 'd71e7dcf-af93-4966-8674-18fa35d78d34', '5458decf-a57e-43e2-9eb2-c0457ad4e898', 'eed369c7-a5a5-4ac1-ab3c-9931850c1ed6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:20 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:20 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:20 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.396s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Deleted volume successfully. Aug 20 06:42:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-00429b5d-d9d0-4194-8c4f-a28d5536f5af tempest-SnapshotsActionsTest-792870485 None] Lock "cinder-bdc4aa75-40aa-4ac4-8384-90c932002d2c-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (05a6291d-0d5a-4441-bb38-2cd16d6ff681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22decea4-110a-47ea-8534-84db7544c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22decea4-110a-47ea-8534-84db7544c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1763598780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2533c3-accc-409d-88a2-cee4807e659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:21Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b67a9d-1f09-4de5-8215-071620157e27),volume_type_id=c9b67a9d-1f09-4de5-8215-071620157e27)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26921571-677a-4129-8cde-0720f7af9dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26921571-677a-4129-8cde-0720f7af9dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c47b62-e6f2-4e25-925b-89ebacb423f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c47b62-e6f2-4e25-925b-89ebacb423f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2533c3-accc-409d-88a2-cee4807e659b', 'volume_name': 'volume-8f2533c3-accc-409d-88a2-cee4807e659b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc7b33-121c-4336-823a-2c8bbe043e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc7b33-121c-4336-823a-2c8bbe043e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b653d9-9be5-4b4f-a1f5-20e6a5529abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:21 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume 8f2533c3-accc-409d-88a2-cee4807e659b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2533c3-accc-409d-88a2-cee4807e659b', 'volume_size': 1} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1763598780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2533c3-accc-409d-88a2-cee4807e659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:21Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b67a9d-1f09-4de5-8215-071620157e27),volume_type_id=c9b67a9d-1f09-4de5-8215-071620157e27)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Creating volume 8f2533c3-accc-409d-88a2-cee4807e659b {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:21 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:21 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b 1073741824 Aug 20 06:42:21 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (f4133182-3060-43c7-9feb-5bd4b73a0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba83d17a-0684-4b42-947e-7302be5f7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba83d17a-0684-4b42-947e-7302be5f7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1596924296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb4b548-8f77-41bd-960c-22a314bee592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:22Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6d14f3-a6d9-403f-a80f-ae3d0733a3fb),volume_type_id=9e6d14f3-a6d9-403f-a80f-ae3d0733a3fb)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd85332e-340c-43d2-919c-8bcada14d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd85332e-340c-43d2-919c-8bcada14d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dc2a93-24a7-42d6-b18a-6a90e064588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dc2a93-24a7-42d6-b18a-6a90e064588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb4b548-8f77-41bd-960c-22a314bee592', 'volume_name': 'volume-beb4b548-8f77-41bd-960c-22a314bee592', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73b65c9-d684-48b2-a9e5-8b43c5330220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73b65c9-d684-48b2-a9e5-8b43c5330220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e58ebf-0817-487b-892d-ece56e266586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume beb4b548-8f77-41bd-960c-22a314bee592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb4b548-8f77-41bd-960c-22a314bee592', 'volume_size': 1} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:22 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b 1073741824" returned: 0 in 0.732s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:22 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b Aug 20 06:42:22 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:22 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b" returned: 0 in 0.476s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1596924296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb4b548-8f77-41bd-960c-22a314bee592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:22Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6d14f3-a6d9-403f-a80f-ae3d0733a3fb),volume_type_id=9e6d14f3-a6d9-403f-a80f-ae3d0733a3fb)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Creating volume beb4b548-8f77-41bd-960c-22a314bee592 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:22 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:22 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 1073741824 Aug 20 06:42:22 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b653d9-9be5-4b4f-a1f5-20e6a5529abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2533c3-accc-409d-88a2-cee4807e659b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c8650f-92e5-4db2-9d47-ba2179d85806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume volume-8f2533c3-accc-409d-88a2-cee4807e659b (8f2533c3-accc-409d-88a2-cee4807e659b): created successfully Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c8650f-92e5-4db2-9d47-ba2179d85806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (05a6291d-0d5a-4441-bb38-2cd16d6ff681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0702b58d-cdf9-4265-820f-7ef1c7ac0209 tempest-TestInstancesWithCinderVolumes-436088650 None] Created volume successfully. Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (c38b90b0-4515-4465-97a6-b05d968b0f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f9c20-40a1-4d08-bee1-c80a313826b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f9c20-40a1-4d08-bee1-c80a313826b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841862344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd110395-8de4-4521-be13-15ee86a616f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:23Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(229e2d7e-a920-4b16-9f9d-b270fa9ecbda),volume_type_id=229e2d7e-a920-4b16-9f9d-b270fa9ecbda)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea748ad-3aa2-47ea-b129-f77db895c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea748ad-3aa2-47ea-b129-f77db895c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33fca37-9806-4bdb-9ce0-1d215f776da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:42:23 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-c2b90a9b-3521-4874-ae05-3690cf293864-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 1073741824" returned: 0 in 0.688s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-c2b90a9b-3521-4874-ae05-3690cf293864-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-quobyte-c2b90a9b-3521-4874-ae05-3690cf293864" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-c2b90a9b-3521-4874-ae05-3690cf293864" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:23 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 Aug 20 06:42:23 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[68865896-c827-4db6-8d43-e07cbabde845]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33fca37-9806-4bdb-9ce0-1d215f776da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd110395-8de4-4521-be13-15ee86a616f9', 'volume_name': 'volume-dd110395-8de4-4521-be13-15ee86a616f9', 'volume_size': 1, 'image_id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684983120', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a469928c6fca4f698b0b3b94491ee44f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'created_at': datetime.datetime(2026, 8, 20, 4, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93d24c2-2813-4918-ae71-2c8201eb2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93d24c2-2813-4918-ae71-2c8201eb2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717f2a44-8bad-40eb-a4ed-a66d3cf2fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume dd110395-8de4-4521-be13-15ee86a616f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd110395-8de4-4521-be13-15ee86a616f9', 'volume_size': 1, 'image_id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684983120', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a469928c6fca4f698b0b3b94491ee44f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'created_at': datetime.datetime(2026, 8, 20, 4, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0/file', 'properties': {}}, 'image_service': } Aug 20 06:42:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Trying to clone dd110395-8de4-4521-be13-15ee86a616f9 from image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:42:23 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 Aug 20 06:42:23 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:24 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e58ebf-0817-487b-892d-ece56e266586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb4b548-8f77-41bd-960c-22a314bee592', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c296db5e-5e95-476e-abe1-6db1135fc1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume volume-beb4b548-8f77-41bd-960c-22a314bee592 (beb4b548-8f77-41bd-960c-22a314bee592): created successfully Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c296db5e-5e95-476e-abe1-6db1135fc1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (f4133182-3060-43c7-9feb-5bd4b73a0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d6f47111-554d-44bb-b60d-4616596e03e2 tempest-TestInstancesWithCinderVolumes-436088650 None] Created volume successfully. Aug 20 06:42:24 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864" returned: 0 in 0.578s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:24 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864 Aug 20 06:42:24 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:24 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c2b90a9b-3521-4874-ae05-3690cf293864" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-c2b90a9b-3521-4874-ae05-3690cf293864" released by "delete_volume" :: held 0.999s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (6ed9a099-a082-4d02-b99e-f123830d1735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700cc998-633f-4dd2-bcbe-ab1ad47bc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700cc998-633f-4dd2-bcbe-ab1ad47bc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1247953456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:25Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80018b23-c591-4177-ad43-e52d7e82a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80018b23-c591-4177-ad43-e52d7e82a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be60bccb-9da9-42b2-810f-3d509d176a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be60bccb-9da9-42b2-810f-3d509d176a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03', 'volume_name': 'volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242bf278-bcb6-4313-ba1d-0376ead83e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242bf278-bcb6-4313-ba1d-0376ead83e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6fcc8-2328-4405-a198-93bc43821ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Volume cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03', 'volume_size': 1} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1247953456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fc026c0bb74869934c417087efac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:25Z,use_quota=True,user_id='3e46bd72599d437baaa737c53e415d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Creating volume cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:24 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 1073741824 Aug 20 06:42:24 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:24 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Created reservations ['ef0d0c50-ef62-49c6-9f02-d2d5b07fc78b', 'ae2b7132-2761-466a-8053-65c162eff872', '98583700-9ac5-436e-9a0e-b70123babb82', '8b1037d1-98dc-49b8-b0e3-7fcc023c8805'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:25 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:25 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:25 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.323s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Deleted volume successfully. Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-947577bb-18fb-4d8f-8e20-a3df702fdd13 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-c2b90a9b-3521-4874-ae05-3690cf293864-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:25 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 1073741824" returned: 0 in 0.561s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:25 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 Aug 20 06:42:25 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:25 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" returned: 0 in 0.285s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6fcc8-2328-4405-a198-93bc43821ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dec2fa-a354-4c64-9c5d-63560db05b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Volume volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 (cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03): created successfully Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dec2fa-a354-4c64-9c5d-63560db05b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Flow 'volume_create_manager' (6ed9a099-a082-4d02-b99e-f123830d1735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1d9a2cf9-0c47-4229-8eb8-bc6ec064a341 tempest-AttachVolumeNegativeTest-1918186608 None] Created volume successfully. Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-319c6c90-b907-4e14-8f20-53b159e37c44-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-319c6c90-b907-4e14-8f20-53b159e37c44-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-quobyte-319c6c90-b907-4e14-8f20-53b159e37c44" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-319c6c90-b907-4e14-8f20-53b159e37c44" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e71672-7861-4771-a633-a011bbd8cc54]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:26 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 Aug 20 06:42:26 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:26 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44" returned: 0 in 0.404s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:26 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44 Aug 20 06:42:26 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:26 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-319c6c90-b907-4e14-8f20-53b159e37c44" returned: 0 in 0.299s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-319c6c90-b907-4e14-8f20-53b159e37c44" released by "delete_volume" :: held 0.751s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Created reservations ['3719c49f-09cc-4056-a17e-43606314774f', '84d7b6ec-da46-487d-b4f5-e3e840e6b623', '5a41fcd2-7530-4c21-ad7c-89ccaefda3cf', '432c8f0a-3001-40b9-bb82-1f4c4577441a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:26 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:26 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:27 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.346s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:27 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Deleted volume successfully. Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a095064e-f93b-4643-a7c8-f6afa9541533 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-319c6c90-b907-4e14-8f20-53b159e37c44-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-6f56ea0b-82c9-4b50-b171-7d9100f181ca-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-6f56ea0b-82c9-4b50-b171-7d9100f181ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "cinder-quobyte-6f56ea0b-82c9-4b50-b171-7d9100f181ca" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-6f56ea0b-82c9-4b50-b171-7d9100f181ca" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c330939d-60e1-4ff0-9b75-bd284891c4b7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:27 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca Aug 20 06:42:27 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-108b5d0c-c67d-49d9-9573-a56363cd2e10 req-c6f6db47-64b2-45e8-8938-2f019b491912 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-108b5d0c-c67d-49d9-9573-a56363cd2e10 req-c6f6db47-64b2-45e8-8938-2f019b491912 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-108b5d0c-c67d-49d9-9573-a56363cd2e10 req-c6f6db47-64b2-45e8-8938-2f019b491912 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-108b5d0c-c67d-49d9-9573-a56363cd2e10 req-c6f6db47-64b2-45e8-8938-2f019b491912 tempest-AttachVolumeNegativeTest-1918186608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44f60a2d-3b10-418a-a67b-150fb18b1093', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:42:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-108b5d0c-c67d-49d9-9573-a56363cd2e10 req-c6f6db47-64b2-45e8-8938-2f019b491912 tempest-AttachVolumeNegativeTest-1918186608 None] attachment_update completed successfully. Aug 20 06:42:28 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca" returned: 0 in 0.438s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:28 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca Aug 20 06:42:28 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:28 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f56ea0b-82c9-4b50-b171-7d9100f181ca" returned: 0 in 0.295s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-quobyte-6f56ea0b-82c9-4b50-b171-7d9100f181ca" released by "delete_volume" :: held 0.811s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Created reservations ['f6f04c35-feca-4f88-a77b-cf5d636757f3', 'b5ff6ffb-6453-44a9-8954-475b216b0013', 'c84100cf-af61-4a37-addc-2ab88f615881', '57b9a39e-a6ef-4a91-a6f4-2aa619be1853'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:28 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:28 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:29 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.349s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Deleted volume successfully. Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11095760-5d4c-4dd7-8843-89d1d83332a1 tempest-AttachVolumeTestJSON-1774153121 None] Lock "cinder-6f56ea0b-82c9-4b50-b171-7d9100f181ca-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD, size 20.69 MB, duration 5.36 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:42:29 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Image download 20.69 MB at 3.86 MB/s Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b6402-97d9-4571-a562-ddb47a638a13]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:29 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD Aug 20 06:42:29 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:29 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Temporary image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 is fetched for user 8183e4e96b3f4873bb92e82b8996fbd2. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dabf95-f3d6-4aa3-91b8-6719f30dada1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:29 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD Aug 20 06:42:29 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:30 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841862344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd110395-8de4-4521-be13-15ee86a616f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a469928c6fca4f698b0b3b94491ee44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:23Z,use_quota=True,user_id='8183e4e96b3f4873bb92e82b8996fbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(229e2d7e-a920-4b16-9f9d-b270fa9ecbda),volume_type_id=229e2d7e-a920-4b16-9f9d-b270fa9ecbda)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Creating volume dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:30 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1073741824 Aug 20 06:42:30 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:30 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1073741824" returned: 0 in 0.592s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:31 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 Aug 20 06:42:31 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-9a0bcb7c-d343-4160-bb90-ef6a5694bea9 req-f9fda9c6-2b67-447f-b85d-f2df619759eb tempest-AttachVolumeNegativeTest-1918186608 None] Terminate volume connection completed successfully. Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-9a0bcb7c-d343-4160-bb90-ef6a5694bea9 req-f9fda9c6-2b67-447f-b85d-f2df619759eb tempest-AttachVolumeNegativeTest-1918186608 None] Deleting attachment 44f60a2d-3b10-418a-a67b-150fb18b1093. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:42:31 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9" returned: 0 in 0.332s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Attempting download of 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}])) to volume dd110395-8de4-4521-be13-15ee86a616f9. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f379de9-2acf-4456-9fbf-9e5c1cb5aaad]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:31 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q Aug 20 06:42:31 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:31 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q" returned: 0 in 0.431s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:31 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q Aug 20 06:42:31 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:32 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q" returned: 1 in 0.449s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_nox2wo9q' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695a531-9efb-45a0-99f5-c59cf096579a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:32 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD Aug 20 06:42:32 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:32 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:42:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:33 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 Aug 20 06:42:33 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:34 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:34 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:34 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:42:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:42:35 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9" returned: 0 in 2.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0_je17zh1tdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:42:35 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Converted 112.00 MB image at 47.29 MB/s Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:35 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1G Aug 20 06:42:35 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:35 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 1G" returned: 0 in 0.560s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Downloaded image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}])) to volume dd110395-8de4-4521-be13-15ee86a616f9 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Temporary image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 for user 8183e4e96b3f4873bb92e82b8996fbd2 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Marking volume dd110395-8de4-4521-be13-15ee86a616f9 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Copying metadata from image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 to dd110395-8de4-4521-be13-15ee86a616f9. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:42:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Creating volume glance metadata for volume dd110395-8de4-4521-be13-15ee86a616f9 backed by image 8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0 with: {'image_id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'image_name': 'tempest-scenario-img--1684983120', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:42:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717f2a44-8bad-40eb-a4ed-a66d3cf2fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd110395-8de4-4521-be13-15ee86a616f9', 'volume_size': 1, 'image_id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684983120', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a469928c6fca4f698b0b3b94491ee44f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0', 'created_at': datetime.datetime(2026, 8, 20, 4, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0d1815-cc99-4a9b-97e6-c0abc4fbbba0/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9324f2c5-5007-48f1-8ea2-7a081a542d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:36 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Volume volume-dd110395-8de4-4521-be13-15ee86a616f9 (dd110395-8de4-4521-be13-15ee86a616f9): created successfully Aug 20 06:42:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9324f2c5-5007-48f1-8ea2-7a081a542d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Flow 'volume_create_manager' (c38b90b0-4515-4465-97a6-b05d968b0f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a96f8182-9bbb-4cb2-957c-0108adf6bc17 tempest-TestInstancesWithCinderVolumes-436088650 None] Created volume successfully. Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-quobyte-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f407b63-2671-4dd8-a2db-7b78a6b76910]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:38 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 Aug 20 06:42:38 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:38 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" returned: 0 in 0.620s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:38 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03 Aug 20 06:42:38 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:39 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" returned: 0 in 0.423s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03" released by "delete_volume" :: held 1.102s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Created reservations ['f9a1a46c-a4ac-44d6-bb79-cad8e527c99e', '44a5deee-099d-4786-aaa1-ec824fc220ab', '1c6f49f2-19e8-4c2e-9e93-7adab75cb575', 'a169b395-feb0-4496-9472-498d5c99fd2e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:39 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:39 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:39 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Deleted volume successfully. Aug 20 06:42:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79bf2527-a9ea-4096-8692-94623b58cb33 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-cf30dc3c-873e-4bd3-96fd-3ef6aea1fb03-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-2f2df22d-ee6c-4af3-b489-cc4f18868e47 req-90ff859f-4282-4759-a534-b283921c9513 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-2f2df22d-ee6c-4af3-b489-cc4f18868e47 req-90ff859f-4282-4759-a534-b283921c9513 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-2f2df22d-ee6c-4af3-b489-cc4f18868e47 req-90ff859f-4282-4759-a534-b283921c9513 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-2f2df22d-ee6c-4af3-b489-cc4f18868e47 req-90ff859f-4282-4759-a534-b283921c9513 tempest-TestInstancesWithCinderVolumes-436088650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-dd110395-8de4-4521-be13-15ee86a616f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8638b1fd-49eb-4e19-9664-57d47d32c097', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:42:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-2f2df22d-ee6c-4af3-b489-cc4f18868e47 req-90ff859f-4282-4759-a534-b283921c9513 tempest-TestInstancesWithCinderVolumes-436088650 None] attachment_update completed successfully. Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Flow 'volume_create_manager' (e0999e83-f482-4c4f-a8f4-91b7a0fce937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2022a9d-123d-490c-81ea-0117f70b524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-ddbb5cd8-8691-492d-a16c-42c8c9c390c4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2022a9d-123d-490c-81ea-0117f70b524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1619473048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea604482-f72f-4074-997b-fd8970c67a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341a78d60964bc18aefd0623b9d94ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:41Z,use_quota=True,user_id='1e1dab35d9254ba7b13d873e3f33a661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83db9a9-b0e4-4768-bf1e-0274d96b94d8),volume_type_id=d83db9a9-b0e4-4768-bf1e-0274d96b94d8)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657bd74e-d4f8-474b-bef2-ef751c4fae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657bd74e-d4f8-474b-bef2-ef751c4fae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8dcef-bd12-4784-adac-6234165eabce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8dcef-bd12-4784-adac-6234165eabce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea604482-f72f-4074-997b-fd8970c67a6a', 'volume_name': 'volume-ea604482-f72f-4074-997b-fd8970c67a6a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6697d486-7f98-4abc-a5bf-f3f576fee64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6697d486-7f98-4abc-a5bf-f3f576fee64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ae2802-896f-4b84-bfd6-d7587e76641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Volume ea604482-f72f-4074-997b-fd8970c67a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea604482-f72f-4074-997b-fd8970c67a6a', 'volume_size': 1} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1619473048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea604482-f72f-4074-997b-fd8970c67a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341a78d60964bc18aefd0623b9d94ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:41Z,use_quota=True,user_id='1e1dab35d9254ba7b13d873e3f33a661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83db9a9-b0e4-4768-bf1e-0274d96b94d8),volume_type_id=d83db9a9-b0e4-4768-bf1e-0274d96b94d8)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Creating volume ea604482-f72f-4074-997b-fd8970c67a6a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:41 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-ddbb5cd8-8691-492d-a16c-42c8c9c390c4-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:41 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a 1073741824 Aug 20 06:42:41 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-quobyte-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09bcdf-4ce2-40d6-b8c4-eea0ffebf8f3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:41 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 Aug 20 06:42:41 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:42:41 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Flow 'volume_create_manager' (bc061723-c265-4739-852c-cd5b644a97be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8e1650-c1de-4064-80e8-054ed91de1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" returned: 0 in 0.605s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:41 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8e1650-c1de-4064-80e8-054ed91de1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-377770205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404bddfc-9e12-4142-9a79-503857d750d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878a26818e9c49cab165459c195a5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:42Z,use_quota=True,user_id='a114491980664cf18c21d1ec55e21cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4 Aug 20 06:42:41 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bfb3c6-fb2b-4026-a226-0da21fc8f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bfb3c6-fb2b-4026-a226-0da21fc8f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c000daa-8e1a-4783-a41c-845229dbd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c000daa-8e1a-4783-a41c-845229dbd29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '404bddfc-9e12-4142-9a79-503857d750d0', 'volume_name': 'volume-404bddfc-9e12-4142-9a79-503857d750d0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f8d67d-2948-42a9-ab01-d3f80bca3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f8d67d-2948-42a9-ab01-d3f80bca3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2830d1d6-f069-45e9-98ad-ff62d1addc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Volume 404bddfc-9e12-4142-9a79-503857d750d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-404bddfc-9e12-4142-9a79-503857d750d0', 'volume_size': 1} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a 1073741824" returned: 0 in 0.839s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:42 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a Aug 20 06:42:42 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:42 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" returned: 0 in 0.303s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-ddbb5cd8-8691-492d-a16c-42c8c9c390c4" released by "delete_volume" :: held 0.973s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Created reservations ['34168daa-c74c-47f6-9827-85345d1e9970', '19d8d7ee-7253-43af-b451-587b04c56f8f', '6ec0bdff-ffea-4c20-be21-1e240a41182c', 'c8984571-a379-43a9-a033-b9dc5e7c00a6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:42 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a" returned: 0 in 0.274s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-377770205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404bddfc-9e12-4142-9a79-503857d750d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878a26818e9c49cab165459c195a5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:42:42Z,use_quota=True,user_id='a114491980664cf18c21d1ec55e21cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Creating volume 404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:42:42 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ae2802-896f-4b84-bfd6-d7587e76641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea604482-f72f-4074-997b-fd8970c67a6a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de80ae4-b1e8-4b00-b64e-f100517d58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:42 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 1073741824 Aug 20 06:42:42 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Volume volume-ea604482-f72f-4074-997b-fd8970c67a6a (ea604482-f72f-4074-997b-fd8970c67a6a): created successfully Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de80ae4-b1e8-4b00-b64e-f100517d58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Flow 'volume_create_manager' (e0999e83-f482-4c4f-a8f4-91b7a0fce937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2d760819-b58e-4bb6-b02d-56e5c2bf7f3a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Created volume successfully. Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:42 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:42 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:42 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Deleted volume successfully. Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7d21cd48-bc71-4dd2-9fa1-d903c1a858ab tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-ddbb5cd8-8691-492d-a16c-42c8c9c390c4-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:42 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 1073741824" returned: 0 in 0.598s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:42 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 Aug 20 06:42:42 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:43 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2830d1d6-f069-45e9-98ad-ff62d1addc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-404bddfc-9e12-4142-9a79-503857d750d0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb1d66-5e84-4248-93a9-fc6b750d2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:42:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Volume volume-404bddfc-9e12-4142-9a79-503857d750d0 (404bddfc-9e12-4142-9a79-503857d750d0): created successfully Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb1d66-5e84-4248-93a9-fc6b750d2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Flow 'volume_create_manager' (bc061723-c265-4739-852c-cd5b644a97be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:42:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-086a60a5-5c15-444f-9308-aa9ec70c1fe5 req-b877110c-5f3d-48a1-b6d7-844ecea0a1ba tempest-VolumesSnapshotsTestJSON-1168424709 None] Created volume successfully. Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:43 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:43 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-3babcf87-3519-4d12-98e8-d4a4f3cfcead-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-3babcf87-3519-4d12-98e8-d4a4f3cfcead-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "cinder-quobyte-3babcf87-3519-4d12-98e8-d4a4f3cfcead" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-3babcf87-3519-4d12-98e8-d4a4f3cfcead" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9630c6f3-3782-45c4-a27f-573acc965102]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:44 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead Aug 20 06:42:44 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:44 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.582s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4cf9441e-30f6-4505-b6a1-6fe58f3e1a76 tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Retype volume completed successfully. Aug 20 06:42:44 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead" returned: 0 in 0.857s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:44 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead Aug 20 06:42:44 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Creating offline snapshot cff9f90e-44b0-4a1e-9991-34c90eabffcd of volume 404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb078f32-8faf-4723-bbff-a98f00e8af58]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "cinder-ea604482-f72f-4074-997b-fd8970c67a6a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "cinder-ea604482-f72f-4074-997b-fd8970c67a6a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:45 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3babcf87-3519-4d12-98e8-d4a4f3cfcead" returned: 0 in 0.462s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:45 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 Aug 20 06:42:45 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-quobyte-3babcf87-3519-4d12-98e8-d4a4f3cfcead" released by "delete_volume" :: held 1.424s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "cinder-quobyte-ea604482-f72f-4074-997b-fd8970c67a6a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "cinder-quobyte-ea604482-f72f-4074-997b-fd8970c67a6a" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe030c-d18e-4286-8984-f0810dbc8263]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Created reservations ['1ea5b766-b4c6-43bd-bc15-2ab173aa59e7', '902d92c2-9dd6-4a59-933c-8e5a33622e79', '974619de-46d4-42b8-8110-0907ba61cc9e', '12061639-b779-49b1-aa5a-94045c13c279'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:45 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a Aug 20 06:42:45 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:45 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:45 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:45 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0" returned: 0 in 0.668s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:45 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd 1G Aug 20 06:42:45 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:45 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Deleted volume successfully. Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f56d693-1e26-44df-a0f5-1c8edfb1e4a6 tempest-AttachVolumeNegativeTest-1918186608 None] Lock "cinder-3babcf87-3519-4d12-98e8-d4a4f3cfcead-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:45 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a" returned: 0 in 0.631s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:45 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a Aug 20 06:42:45 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd 1G" returned: 0 in 0.556s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404bddfc-9e12-4142-9a79-503857d750d0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:46 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:46 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404bddfc-9e12-4142-9a79-503857d750d0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd Aug 20 06:42:46 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:46 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ea604482-f72f-4074-997b-fd8970c67a6a" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "cinder-quobyte-ea604482-f72f-4074-997b-fd8970c67a6a" released by "delete_volume" :: held 1.058s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:46 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:42:46 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Created reservations ['616c464d-027f-41b0-b829-22575018bb81', 'eaff3a0a-f2b0-4e22-ac29-d1a0d2dd56d3', '23c8f27c-5b91-4035-8b15-867ffdd701e4', '8e8850a5-e357-4e23-815f-785f504044de'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:46 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:46 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:46 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404bddfc-9e12-4142-9a79-503857d750d0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd" returned: 0 in 0.499s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:46 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd is being set with open permissions: ugo+rw Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:46 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd Aug 20 06:42:46 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:46 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.400s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:46 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Deleted volume successfully. Aug 20 06:42:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7bccb8ab-2513-4c6d-ae8a-f10569dd8b7a tempest-VolumeRetypeWithoutMigrationTest-1785289975 None] Lock "cinder-ea604482-f72f-4074-997b-fd8970c67a6a-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:47 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd" returned: 0 in 0.516s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:47 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info Aug 20 06:42:47 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:47 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info" returned: 0 in 0.521s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:47 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info is being set with open permissions: ugo+rw Aug 20 06:42:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:47 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info Aug 20 06:42:47 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:48 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.info" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-fe2e9a41-0785-44e9-bc51-259b4e84f111 req-00ef7fef-70f5-4fb3-ab97-530c75686a57 tempest-VolumesSnapshotsTestJSON-1168424709 None] Create snapshot completed successfully Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "cinder-cff9f90e-44b0-4a1e-9991-34c90eabffcd-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-cff9f90e-44b0-4a1e-9991-34c90eabffcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "cinder-quobyte-cff9f90e-44b0-4a1e-9991-34c90eabffcd" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-cff9f90e-44b0-4a1e-9991-34c90eabffcd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Deleting offline snapshot cff9f90e-44b0-4a1e-9991-34c90eabffcd of volume 404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] snapshot_file for this snap is: volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb734c-aac9-456a-802f-f14fa3c4675a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:49 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd Aug 20 06:42:49 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:49 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd" returned: 0 in 0.569s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-404bddfc-9e12-4142-9a79-503857d750d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad91900-ebf8-4e88-a5c9-9d8f70db7ea8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:49 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 Aug 20 06:42:49 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:50 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0" returned: 0 in 0.648s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:50 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd Aug 20 06:42:50 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:50 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd" returned: 0 in 0.498s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:50 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd Aug 20 06:42:50 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:51 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0.cff9f90e-44b0-4a1e-9991-34c90eabffcd" returned: 0 in 0.309s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-cff9f90e-44b0-4a1e-9991-34c90eabffcd" released by "_delete_snapshot" :: held 2.213s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" released by "delete_snapshot" :: held 2.259s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:51 devstack cinder-volume[94234]: DEBUG cinder.quota [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Created reservations ['737d57ab-d76b-4f91-80f7-77ca301b2998', '2521711c-84e8-4566-9248-70eee8357ae4', 'bd338c83-5e8a-480e-91ca-85659ba62a38', '78b5d3b6-8921-455e-b70e-6d7bbfa5b1b5'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:51 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Delete snapshot completed successfully. Aug 20 06:42:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-dc8859d3-a5cd-4e2c-883d-cfb10d7b830f req-8705be3c-bf82-4225-bafb-09b0be04a0d7 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-cff9f90e-44b0-4a1e-9991-34c90eabffcd-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "cinder-404bddfc-9e12-4142-9a79-503857d750d0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-404bddfc-9e12-4142-9a79-503857d750d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605df19-e324-4c25-8abc-3c1d2ac01f10]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:42:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:52 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 Aug 20 06:42:52 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:53 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0" returned: 0 in 0.887s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:53 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0 Aug 20 06:42:53 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:54 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-404bddfc-9e12-4142-9a79-503857d750d0" returned: 0 in 0.507s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-quobyte-404bddfc-9e12-4142-9a79-503857d750d0" released by "delete_volume" :: held 1.528s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG cinder.quota [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Created reservations ['f3d40f5f-e2c5-417a-8fbb-6115dfe812e2', 'e4544090-909e-4d79-956c-b15587100070', '6acf4bed-fe60-4e4a-9dc2-ece2a4bc31ed', '709f629c-b5d1-4bd5-9cd3-418d9f577219'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:42:54 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:42:54 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:42:54 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.651s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:42:54 devstack cinder-volume[94234]: DEBUG cinder.manager [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:42:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Deleted volume successfully. Aug 20 06:42:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-ebc2c92e-9d7d-4441-bed4-c93edc29befd req-ec261c5d-6d5f-41ab-944f-147ec2e607e1 tempest-VolumesSnapshotsTestJSON-1168424709 None] Lock "cinder-404bddfc-9e12-4142-9a79-503857d750d0-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (2f94d911-66c9-48a4-b5ce-f1c6e2a5ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eff753-0edf-4e9b-90b1-290fad73c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eff753-0edf-4e9b-90b1-290fad73c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-684298796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e76573-47d9-4ed9-bd83-d7a5939cdd05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:01Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7cf2731-626b-4fdd-a036-44077d7f81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7cf2731-626b-4fdd-a036-44077d7f81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92815ca-97bd-4253-90f4-8294230460dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92815ca-97bd-4253-90f4-8294230460dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e76573-47d9-4ed9-bd83-d7a5939cdd05', 'volume_name': 'volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1311b2c9-4441-42f8-a66b-a8dde1a5d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1311b2c9-4441-42f8-a66b-a8dde1a5d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fa7629-4ca4-4d0d-9cfd-9330ab71e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:00 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Volume 07e76573-47d9-4ed9-bd83-d7a5939cdd05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05', 'volume_size': 1} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-684298796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e76573-47d9-4ed9-bd83-d7a5939cdd05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:01Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Creating volume 07e76573-47d9-4ed9-bd83-d7a5939cdd05 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:00 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:00 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 1073741824 Aug 20 06:43:00 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:01 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 1073741824" returned: 0 in 0.684s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:01 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 Aug 20 06:43:01 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:01 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05" returned: 0 in 0.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fa7629-4ca4-4d0d-9cfd-9330ab71e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca180d7-03d9-45fa-8b99-59ca6fb52e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:02 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Volume volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 (07e76573-47d9-4ed9-bd83-d7a5939cdd05): created successfully Aug 20 06:43:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca180d7-03d9-45fa-8b99-59ca6fb52e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (2f94d911-66c9-48a4-b5ce-f1c6e2a5ee73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ddc20bc7-8252-451a-b11d-69aa65dc3258 tempest-VolumesTestJSON-1871351348 None] Created volume successfully. Aug 20 06:43:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e06b9e16-4e42-4991-99a8-bb1b71978e2f tempest-GroupsV314Test-1915309331 None] Group tempest-GroupsV314Test-Group-960238385: creating Aug 20 06:43:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e06b9e16-4e42-4991-99a8-bb1b71978e2f tempest-GroupsV314Test-1915309331 None] Group tempest-GroupsV314Test-Group-960238385: created successfully Aug 20 06:43:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e06b9e16-4e42-4991-99a8-bb1b71978e2f tempest-GroupsV314Test-1915309331 None] Create group completed successfully. Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (bede0102-6c20-4362-88dc-369538d8ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e88a8b-3d7d-4b1c-9c90-9aa36976d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e88a8b-3d7d-4b1c-9c90-9aa36976d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-574714956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e39b8cb-244b-4e8d-91ff-78cb4e71309b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:04Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a0f583-940d-44f5-82b9-a7a32e857656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a0f583-940d-44f5-82b9-a7a32e857656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d80925-09d9-4a45-8a35-7ea89f1983df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d80925-09d9-4a45-8a35-7ea89f1983df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e39b8cb-244b-4e8d-91ff-78cb4e71309b', 'volume_name': 'volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7ed3d1-c03e-4d54-bcb6-4cd7eea792ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7ed3d1-c03e-4d54-bcb6-4cd7eea792ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29825a7f-ac50-426c-8f54-582543411054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:03 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Volume 0e39b8cb-244b-4e8d-91ff-78cb4e71309b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b', 'volume_size': 1} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-574714956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e39b8cb-244b-4e8d-91ff-78cb4e71309b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:04Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Creating volume 0e39b8cb-244b-4e8d-91ff-78cb4e71309b {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:03 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:03 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b 1073741824 Aug 20 06:43:03 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:04 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b 1073741824" returned: 0 in 0.575s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:04 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b Aug 20 06:43:04 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:04 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" returned: 0 in 0.351s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29825a7f-ac50-426c-8f54-582543411054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d073b4e0-6d69-427e-aa5d-fedc11809ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:04 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Volume volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b (0e39b8cb-244b-4e8d-91ff-78cb4e71309b): created successfully Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d073b4e0-6d69-427e-aa5d-fedc11809ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (bede0102-6c20-4362-88dc-369538d8ee82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5978d9a5-f826-4ba5-a9fe-e809634e64f9 tempest-VolumesTestJSON-1871351348 None] Created volume successfully. Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Flow 'volume_create_manager' (986937ce-4602-4eb7-a76a-6750b4609ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ba3d4d-83fe-4ba1-b4e5-6badc670e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ba3d4d-83fe-4ba1-b4e5-6badc670e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386804676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26543f0-86c3-4dfc-970f-514ecc739da7,host='devstack@QuobyteHD#QuobyteHD',id=2701a135-afa7-4814-957a-adf3d7d04c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65d52a3189b445b8e156a7c1de015cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:05Z,use_quota=True,user_id='9c71a0a849f24077af3cb82902746fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0afde7e-90b7-48c9-951c-ac38da398e42),volume_type_id=e0afde7e-90b7-48c9-951c-ac38da398e42)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb3ab10-749a-4794-aea8-befb053212d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb3ab10-749a-4794-aea8-befb053212d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05db9eb4-41e8-4434-b94d-34715c28ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05db9eb4-41e8-4434-b94d-34715c28ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2701a135-afa7-4814-957a-adf3d7d04c0c', 'volume_name': 'volume-2701a135-afa7-4814-957a-adf3d7d04c0c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18419f34-2e35-4e46-a889-ecadb7e2350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18419f34-2e35-4e46-a889-ecadb7e2350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2625003-fbbc-42ec-a925-39b6b285d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:05 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Volume 2701a135-afa7-4814-957a-adf3d7d04c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2701a135-afa7-4814-957a-adf3d7d04c0c', 'volume_size': 1} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a26543f0-86c3-4dfc-970f-514ecc739da7,created_at=2026-08-20T04:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386804676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26543f0-86c3-4dfc-970f-514ecc739da7,host='devstack@QuobyteHD#QuobyteHD',id=2701a135-afa7-4814-957a-adf3d7d04c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65d52a3189b445b8e156a7c1de015cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:05Z,use_quota=True,user_id='9c71a0a849f24077af3cb82902746fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0afde7e-90b7-48c9-951c-ac38da398e42),volume_type_id=e0afde7e-90b7-48c9-951c-ac38da398e42)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Creating volume 2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:05 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:05 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c 1073741824 Aug 20 06:43:05 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:05 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c 1073741824" returned: 0 in 0.574s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:05 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:05 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:06 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.374s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2625003-fbbc-42ec-a925-39b6b285d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2701a135-afa7-4814-957a-adf3d7d04c0c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af2911-7417-459c-bcba-5d9ee9b5d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Volume volume-2701a135-afa7-4814-957a-adf3d7d04c0c (2701a135-afa7-4814-957a-adf3d7d04c0c): created successfully Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af2911-7417-459c-bcba-5d9ee9b5d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Flow 'volume_create_manager' (986937ce-4602-4eb7-a76a-6750b4609ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ceb31c97-7d4f-4425-98a4-08e1cd3f7035 tempest-GroupsV314Test-1915309331 None] Created volume successfully. Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (f48b6d9d-2476-42bd-b2b3-dc14385ebd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8600e68d-4e5a-4a50-bd0d-942d92915ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8600e68d-4e5a-4a50-bd0d-942d92915ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-863641498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3221a711-40a8-424d-89c0-f66844c95b50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:06Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988a0170-ec10-4d20-b416-a63a25c5cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988a0170-ec10-4d20-b416-a63a25c5cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f8a1d8-5842-4907-a757-bee824d1e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f8a1d8-5842-4907-a757-bee824d1e7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3221a711-40a8-424d-89c0-f66844c95b50', 'volume_name': 'volume-3221a711-40a8-424d-89c0-f66844c95b50', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b61a9df-e539-47bd-8663-8d6b9917ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b61a9df-e539-47bd-8663-8d6b9917ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e265f-5315-45da-b6c8-e94a142d409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:06 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Volume 3221a711-40a8-424d-89c0-f66844c95b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3221a711-40a8-424d-89c0-f66844c95b50', 'volume_size': 1} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-863641498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3221a711-40a8-424d-89c0-f66844c95b50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8caec98bbf0e4fc8984426ea191444ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:06Z,use_quota=True,user_id='fc31d68d1c774ab5b581dd9b2c271c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Creating volume 3221a711-40a8-424d-89c0-f66844c95b50 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:06 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:06 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 1073741824 Aug 20 06:43:06 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:07 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 1073741824" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:07 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 Aug 20 06:43:07 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:07 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50" returned: 0 in 0.266s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e265f-5315-45da-b6c8-e94a142d409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3221a711-40a8-424d-89c0-f66844c95b50', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbf435d-232c-4185-80ec-1c47d79e2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Volume volume-3221a711-40a8-424d-89c0-f66844c95b50 (3221a711-40a8-424d-89c0-f66844c95b50): created successfully Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbf435d-232c-4185-80ec-1c47d79e2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Flow 'volume_create_manager' (f48b6d9d-2476-42bd-b2b3-dc14385ebd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-170fa98c-4c05-479a-8a94-ceebaf6fde01 tempest-VolumesTestJSON-1871351348 None] Created volume successfully. Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:08 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Cloning volume 2701a135-afa7-4814-957a-adf3d7d04c0c to volume d6092b44-e3a0-4583-9cf9-d75c8855d1f5 Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Creating offline snapshot ce3dc036-1dae-4783-933b-9a7e48c87b42 of volume 2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2fe26-351d-4700-9e44-7b8827635068]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:08 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:08 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:08 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.475s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:08 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 1G Aug 20 06:43:08 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:09 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 1G" returned: 0 in 0.512s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2701a135-afa7-4814-957a-adf3d7d04c0c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:09 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2701a135-afa7-4814-957a-adf3d7d04c0c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:09 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:09 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2701a135-afa7-4814-957a-adf3d7d04c0c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.344s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:09 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-3221a711-40a8-424d-89c0-f66844c95b50-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:09 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:09 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "cinder-3221a711-40a8-424d-89c0-f66844c95b50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=135,cinder:INSERT=46,cinder:UPDATE=148,cinder:DELETE=7 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=131,cinder:INSERT=28,cinder:UPDATE=134,cinder:DELETE=15 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-quobyte-3221a711-40a8-424d-89c0-f66844c95b50" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-3221a711-40a8-424d-89c0-f66844c95b50" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b623d9-13a2-4230-b553-28dbca72d807]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 Aug 20 06:43:10 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:10 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.455s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info Aug 20 06:43:10 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:10 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50" returned: 0 in 0.489s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50 Aug 20 06:43:10 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:10 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info" returned: 0 in 0.309s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:10 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info Aug 20 06:43:10 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:10 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3221a711-40a8-424d-89c0-f66844c95b50" returned: 0 in 0.282s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-3221a711-40a8-424d-89c0-f66844c95b50" released by "delete_volume" :: held 0.851s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:10 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Created reservations ['8b960cff-01f1-4efe-9635-f5438245c281', '65b2dee8-8ddb-4897-b330-a4defbe76ebc', '7b8e6b51-6452-462d-a051-f2fbf19929ed', '1612ad67-d858-4a40-8d48-e29b069fef94'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.info" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Acquiring lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] snapshot: ce3dc036-1dae-4783-933b-9a7e48c87b42, volume: d6092b44-e3a0-4583-9cf9-d75c8855d1f5, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46b6e9f-e0b8-4df7-96ba-35bc4c0d5de6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:10 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:10 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:10 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:10 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:11 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.356s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Deleted volume successfully. Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c024b17-51ca-4b43-a2ce-8aa7778568b2 tempest-VolumesTestJSON-1871351348 None] Lock "cinder-3221a711-40a8-424d-89c0-f66844c95b50-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:11 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.486s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2701a135-afa7-4814-957a-adf3d7d04c0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c646eb-7dd1-4856-ab01-6716f79de37e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:11 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:11 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:11 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.491s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:11 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 Aug 20 06:43:11 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-0e39b8cb-244b-4e8d-91ff-78cb4e71309b-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-0e39b8cb-244b-4e8d-91ff-78cb4e71309b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-quobyte-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[15731f2a-805d-49f4-b100-cad648de062f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:12 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b Aug 20 06:43:12 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:12 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" returned: 0 in 0.698s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:13 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b Aug 20 06:43:13 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:13 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" returned: 0 in 0.686s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-0e39b8cb-244b-4e8d-91ff-78cb4e71309b" released by "delete_volume" :: held 1.501s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:13 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Created reservations ['7e5b7577-df8e-4661-ac8b-e4a1b2de03bc', 'ac7ed846-53a6-4ddb-a73d-cc29fa884f92', '94906601-2b7f-46d4-8a2a-16604509cd3c', '0620d8d9-9314-452a-8fa6-608a07893e3f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:14 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:14 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-07e76573-47d9-4ed9-bd83-d7a5939cdd05-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:15 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 1.023s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-07e76573-47d9-4ed9-bd83-d7a5939cdd05-delete_volume" acquired by "delete_volume" :: waited 0.445s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Deleted volume successfully. Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f77ca6c0-a301-4bd2-a216-d3fe699520ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-0e39b8cb-244b-4e8d-91ff-78cb4e71309b-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "cinder-quobyte-07e76573-47d9-4ed9-bd83-d7a5939cdd05" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-07e76573-47d9-4ed9-bd83-d7a5939cdd05" acquired by "delete_volume" :: waited 0.080s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d8c860-10d8-48cc-8b7f-c4d0435128b4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:15 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 Aug 20 06:43:15 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:16 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05" returned: 0 in 0.779s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:16 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05 Aug 20 06:43:16 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:17 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-07e76573-47d9-4ed9-bd83-d7a5939cdd05" returned: 0 in 0.596s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-quobyte-07e76573-47d9-4ed9-bd83-d7a5939cdd05" released by "delete_volume" :: held 1.558s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Created reservations ['ebb429c9-2a38-463f-b437-c648f7fd4333', 'f3333014-b0d2-4c47-b8fc-b1b9c479040a', '3ccf797d-1976-403f-9f3a-b9ac70a662d9', '535ddc39-3303-4830-9856-5ec48f95f3a6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:17 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:17 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:18 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.666s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:18 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Deleted volume successfully. Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cff6ab01-48af-4109-ac18-ac7ba5d624ae tempest-VolumesTestJSON-1871351348 None] Lock "cinder-07e76573-47d9-4ed9-bd83-d7a5939cdd05-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:18 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" returned: 0 in 6.949s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:43:18 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Converted 1024.00 MB image at 147.31 MB/s Aug 20 06:43:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 is being set with open permissions: ugo+rw: NotImplementedError Aug 20 06:43:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:18 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 Aug 20 06:43:18 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:19 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" released by "_copy_volume_from_snapshot" :: held 8.306s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Acquiring lock "cinder-quobyte-ce3dc036-1dae-4783-933b-9a7e48c87b42" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-ce3dc036-1dae-4783-933b-9a7e48c87b42" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Deleting offline snapshot ce3dc036-1dae-4783-933b-9a7e48c87b42 of volume 2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] snapshot_file for this snap is: volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ed70e-ccb6-41a4-8060-5df83c22be28]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:19 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:19 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:19 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.643s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2701a135-afa7-4814-957a-adf3d7d04c0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6814c1-7738-4173-be7e-6c5bd3e3621f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:20 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:20 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4f93ab72-7dab-4158-8767-6f75c483f108 req-851803b8-e294-4da6-a8c8-8cff41ec4f47 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:20 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.713s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:20 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:20 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:21 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:21 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42 Aug 20 06:43:21 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:21 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c.ce3dc036-1dae-4783-933b-9a7e48c87b42" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-ce3dc036-1dae-4783-933b-9a7e48c87b42" released by "_delete_snapshot" :: held 2.298s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.221s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4f93ab72-7dab-4158-8767-6f75c483f108 req-851803b8-e294-4da6-a8c8-8cff41ec4f47 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.983s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-4f93ab72-7dab-4158-8767-6f75c483f108 req-851803b8-e294-4da6-a8c8-8cff41ec4f47 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4f93ab72-7dab-4158-8767-6f75c483f108 req-851803b8-e294-4da6-a8c8-8cff41ec4f47 tempest-TestInstancesWithCinderVolumes-436088650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-8f2533c3-accc-409d-88a2-cee4807e659b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99029de5-b7f8-4c84-90e7-ec4e8946423a', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:43:21 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7372a1c4-eee4-43b9-85ba-64d6b8af6ea1 tempest-GroupsV314Test-1915309331 None] Create group from source-group-a26543f0-86c3-4dfc-970f-514ecc739da7 completed successfully. Aug 20 06:43:21 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4f93ab72-7dab-4158-8767-6f75c483f108 req-851803b8-e294-4da6-a8c8-8cff41ec4f47 tempest-TestInstancesWithCinderVolumes-436088650 None] attachment_update completed successfully. Aug 20 06:43:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Acquiring lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:22 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d7c629-e4fc-4aae-8884-f8f090ec35b5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:22 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 Aug 20 06:43:22 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:23 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" returned: 0 in 0.467s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:23 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5 Aug 20 06:43:23 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:23 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-d6092b44-e3a0-4583-9cf9-d75c8855d1f5" released by "delete_volume" :: held 0.839s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-07c6ea32-8cf7-4329-88a2-72ca657b0536 tempest-BackendsCapabilitiesAdminTestsJSON-1175475293 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.341567993164, 'free_capacity_gb': 1775.341567993164, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3eb807a9-aef3-4e2a-a061-025b5ea40116 tempest-BackendsCapabilitiesAdminTestsJSON-1175475293 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.341567993164, 'free_capacity_gb': 1775.341567993164, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Created reservations ['1c9cbf8e-d8ba-44b0-b4f3-51ab5275eef5'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:23 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-888434024 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-888434024, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:23 devstack cinder-volume[94234]: WARNING cinder.quota [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-888434024 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-888434024, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Created reservations ['6092907e-6f62-4262-8ab7-fe6fdbd69c7a', 'b6044683-2c39-43db-a9fb-267b4943e4ac', '72ddf81c-1e3e-467a-b2c0-c8edad97dffd', '5eb42de8-fa25-4c33-859b-1ecd733318ea'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:23 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:23 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:24 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7a726640-2bb6-4362-8ed7-392eb5400ffc tempest-GroupsV314Test-1915309331 None] Delete group completed successfully. Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Acquiring lock "cinder-quobyte-2701a135-afa7-4814-957a-adf3d7d04c0c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-2701a135-afa7-4814-957a-adf3d7d04c0c" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1a001c-de26-4c1e-86ec-d16c050596a1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:24 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:24 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:24 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.651s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:25 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c Aug 20 06:43:25 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-37faf3fa-c54e-4df5-8226-b8c1741b0220 req-b701e458-f2d9-4f62-a0e2-bdcd60f8b1e9 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-37faf3fa-c54e-4df5-8226-b8c1741b0220 req-b701e458-f2d9-4f62-a0e2-bdcd60f8b1e9 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-37faf3fa-c54e-4df5-8226-b8c1741b0220 req-b701e458-f2d9-4f62-a0e2-bdcd60f8b1e9 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-37faf3fa-c54e-4df5-8226-b8c1741b0220 req-b701e458-f2d9-4f62-a0e2-bdcd60f8b1e9 tempest-TestInstancesWithCinderVolumes-436088650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-beb4b548-8f77-41bd-960c-22a314bee592', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf3dd3c5-dd81-4f05-89f9-48fb8405c8b1', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:43:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-37faf3fa-c54e-4df5-8226-b8c1741b0220 req-b701e458-f2d9-4f62-a0e2-bdcd60f8b1e9 tempest-TestInstancesWithCinderVolumes-436088650 None] attachment_update completed successfully. Aug 20 06:43:25 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2701a135-afa7-4814-957a-adf3d7d04c0c" returned: 0 in 0.329s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Lock "cinder-quobyte-2701a135-afa7-4814-957a-adf3d7d04c0c" released by "delete_volume" :: held 1.073s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Created reservations ['de9b6717-2cc1-4223-9f4f-6d33846abbec'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Created reservations ['32165600-2b22-4df7-9933-74920d26f620', '8797c50a-14ed-4b52-b680-5857495d87ac', '0a4f5f58-a827-499c-9e8e-1ef55570c0fc', 'b82e63cd-c5b4-4d83-b162-203cfdc7df74'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:25 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:25 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:26 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.468s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:26 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2aefc681-bd03-44e8-be8c-b2a166aa3514 tempest-GroupsV314Test-1915309331 None] Delete group completed successfully. Aug 20 06:43:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-cbcb4989-8f33-4002-86d8-2eef3993d2e7 req-836fecc5-8122-4354-95b8-dc6324cbe824 tempest-TestInstancesWithCinderVolumes-436088650 None] Terminate volume connection completed successfully. Aug 20 06:43:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-cbcb4989-8f33-4002-86d8-2eef3993d2e7 req-836fecc5-8122-4354-95b8-dc6324cbe824 tempest-TestInstancesWithCinderVolumes-436088650 None] Deleting attachment 99029de5-b7f8-4c84-90e7-ec4e8946423a. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:43:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-8f2533c3-accc-409d-88a2-cee4807e659b-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-8f2533c3-accc-409d-88a2-cee4807e659b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-quobyte-8f2533c3-accc-409d-88a2-cee4807e659b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-8f2533c3-accc-409d-88a2-cee4807e659b" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79a8cd3-4db9-4d3d-a70d-4e87ba9a2624]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:33 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b Aug 20 06:43:33 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:33 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b" returned: 0 in 0.696s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:33 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b Aug 20 06:43:33 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:34 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8f2533c3-accc-409d-88a2-cee4807e659b" returned: 0 in 0.396s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-8f2533c3-accc-409d-88a2-cee4807e659b" released by "delete_volume" :: held 1.177s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:34 devstack cinder-volume[94234]: WARNING cinder.quota [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238854527-1526901856 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238854527-1526901856, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:34 devstack cinder-volume[94234]: WARNING cinder.quota [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238854527-1526901856 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238854527-1526901856, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Created reservations ['bc0333f2-1bc0-4474-8c4c-efd1a79be8d4', '44fc11f2-42c5-454f-b945-3e0a76f8aa33', '4ccf3033-70a5-493a-b8fa-6274f7d55180', '3f2c9d2d-0775-481f-8d7f-6f6a6434e24a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:34 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:34 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:34 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:34 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:34 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.462s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Deleted volume successfully. Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dd2b63aa-fd62-430e-9a45-51f9a83a1ca2 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-8f2533c3-accc-409d-88a2-cee4807e659b-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:34 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.559s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:43:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:43:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-58c4f224-b8dc-4462-9a5d-434db1d75ac3 req-b03dedf6-f1b0-4caf-9fce-69ca3ca6c89a tempest-TestInstancesWithCinderVolumes-436088650 None] Terminate volume connection completed successfully. Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-58c4f224-b8dc-4462-9a5d-434db1d75ac3 req-b03dedf6-f1b0-4caf-9fce-69ca3ca6c89a tempest-TestInstancesWithCinderVolumes-436088650 None] Deleting attachment cf3dd3c5-dd81-4f05-89f9-48fb8405c8b1. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-beb4b548-8f77-41bd-960c-22a314bee592-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-beb4b548-8f77-41bd-960c-22a314bee592-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-quobyte-beb4b548-8f77-41bd-960c-22a314bee592" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-beb4b548-8f77-41bd-960c-22a314bee592" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96e42d-fa0f-4bd8-b9da-4f7df12ec011]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:39 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 Aug 20 06:43:39 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:39 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592" returned: 0 in 0.745s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:39 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592 Aug 20 06:43:39 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:40 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-beb4b548-8f77-41bd-960c-22a314bee592" returned: 0 in 0.403s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-beb4b548-8f77-41bd-960c-22a314bee592" released by "delete_volume" :: held 1.239s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:40 devstack cinder-volume[94234]: WARNING cinder.quota [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1169947771-558888910 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1169947771-558888910, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:40 devstack cinder-volume[94234]: WARNING cinder.quota [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1169947771-558888910 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1169947771-558888910, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Created reservations ['54a02add-8596-4e05-83ce-92fdc3ab5d71', '7e44e20d-736b-4133-875f-53b72f72d8ce', '1b1992dd-d06f-4493-8c39-35bcff21e2aa', 'b17838bd-2247-40f8-b9f1-c17d8a0f68cd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:40 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:40 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:40 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.392s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Deleted volume successfully. Aug 20 06:43:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-41f04df0-0e6e-47a7-b21e-a5a75af689af tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-beb4b548-8f77-41bd-960c-22a314bee592-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Flow 'volume_create_manager' (fd2390dc-1819-4f08-8175-ed95cb46d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f986dde-8497-40a2-9863-42dffb2d05f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f986dde-8497-40a2-9863-42dffb2d05f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2072823323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc1c966-9333-4f28-a2fa-ac6faf97232c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a4ffdb0e8f4211a09df65fe37d4577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:42Z,use_quota=True,user_id='2395d2100b7e43098bdf7e1832555ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249c92f3-36c2-42a6-9071-ebf01bcfb4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249c92f3-36c2-42a6-9071-ebf01bcfb4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e219aee9-52ee-42e1-a4df-35b0d41bbc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e219aee9-52ee-42e1-a4df-35b0d41bbc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc1c966-9333-4f28-a2fa-ac6faf97232c', 'volume_name': 'volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a816bda-3f79-4059-86b0-49bc99398084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a816bda-3f79-4059-86b0-49bc99398084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c74026-06e0-43ff-b3ef-054b966862a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume 4bc1c966-9333-4f28-a2fa-ac6faf97232c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c', 'volume_size': 1} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2072823323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc1c966-9333-4f28-a2fa-ac6faf97232c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a4ffdb0e8f4211a09df65fe37d4577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:42Z,use_quota=True,user_id='2395d2100b7e43098bdf7e1832555ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Creating volume 4bc1c966-9333-4f28-a2fa-ac6faf97232c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:42 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:42 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c 1073741824 Aug 20 06:43:42 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:43 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c 1073741824" returned: 0 in 0.588s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:43 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c Aug 20 06:43:43 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:43 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c" returned: 0 in 0.529s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c74026-06e0-43ff-b3ef-054b966862a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272e904c-c382-43ba-a19b-f9027af7a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c (4bc1c966-9333-4f28-a2fa-ac6faf97232c): created successfully Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272e904c-c382-43ba-a19b-f9027af7a992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Flow 'volume_create_manager' (fd2390dc-1819-4f08-8175-ed95cb46d380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-354b7eb8-8187-4d24-afba-1b953db434a3 tempest-VolumeQuotasAdminTestJSON-170118115 None] Created volume successfully. Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "cinder-4bc1c966-9333-4f28-a2fa-ac6faf97232c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "cinder-4bc1c966-9333-4f28-a2fa-ac6faf97232c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "cinder-quobyte-4bc1c966-9333-4f28-a2fa-ac6faf97232c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "cinder-quobyte-4bc1c966-9333-4f28-a2fa-ac6faf97232c" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c16971-35af-49e9-88cc-ae4718326884]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:45 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c Aug 20 06:43:45 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:45 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c" returned: 0 in 0.849s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:45 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c Aug 20 06:43:45 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:46 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4bc1c966-9333-4f28-a2fa-ac6faf97232c" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "cinder-quobyte-4bc1c966-9333-4f28-a2fa-ac6faf97232c" released by "delete_volume" :: held 1.386s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Created reservations ['3eedaa5b-ce1d-48c7-bac1-b4b2e31aa7b7', '4a1565d5-9286-4fec-aa5f-e3bc2a934d3b', '738cb67d-0f31-4121-b5cb-ae4518c71d49', 'daa3a5b8-c113-49df-8568-8ec634e15cad'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:46 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:46 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:46 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.386s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:46 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Deleted volume successfully. Aug 20 06:43:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f509165e-defd-42d8-a7e0-11e443bc7b89 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "cinder-4bc1c966-9333-4f28-a2fa-ac6faf97232c-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-389a14c0-b427-45ec-97fe-4e83676a3d57 req-5c906dda-9391-40c9-b5b2-d32cd1f454b7 tempest-TestInstancesWithCinderVolumes-436088650 None] Terminate volume connection completed successfully. Aug 20 06:43:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-389a14c0-b427-45ec-97fe-4e83676a3d57 req-5c906dda-9391-40c9-b5b2-d32cd1f454b7 tempest-TestInstancesWithCinderVolumes-436088650 None] Deleting attachment 8638b1fd-49eb-4e19-9664-57d47d32c097. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Flow 'volume_create_manager' (255e0a35-63f0-4ded-bfff-c172a0df5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e985636-14d3-4472-9c9b-d520a2b76f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e985636-14d3-4472-9c9b-d520a2b76f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1455551951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7188df56-7e7c-4e8f-a002-1525350659d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a4ffdb0e8f4211a09df65fe37d4577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:48Z,use_quota=True,user_id='2395d2100b7e43098bdf7e1832555ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3111cb9-e445-45b9-a134-ecfcfe6ecb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3111cb9-e445-45b9-a134-ecfcfe6ecb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8195dcdd-cafb-44e3-bda0-a1711250ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8195dcdd-cafb-44e3-bda0-a1711250ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7188df56-7e7c-4e8f-a002-1525350659d8', 'volume_name': 'volume-7188df56-7e7c-4e8f-a002-1525350659d8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee85dca-689d-4c72-9a16-001ce29e4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee85dca-689d-4c72-9a16-001ce29e4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee169a11-7028-4b92-b87a-a54901393140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume 7188df56-7e7c-4e8f-a002-1525350659d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7188df56-7e7c-4e8f-a002-1525350659d8', 'volume_size': 1} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1455551951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7188df56-7e7c-4e8f-a002-1525350659d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a4ffdb0e8f4211a09df65fe37d4577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:48Z,use_quota=True,user_id='2395d2100b7e43098bdf7e1832555ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Creating volume 7188df56-7e7c-4e8f-a002-1525350659d8 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:48 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:48 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 1073741824 Aug 20 06:43:48 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:49 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 1073741824" returned: 0 in 0.771s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:49 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 Aug 20 06:43:49 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-dd110395-8de4-4521-be13-15ee86a616f9-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-dd110395-8de4-4521-be13-15ee86a616f9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "cinder-quobyte-dd110395-8de4-4521-be13-15ee86a616f9" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-dd110395-8de4-4521-be13-15ee86a616f9" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf2b97-c900-431c-9c4e-222d490f73a2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:50 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8" returned: 0 in 0.815s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:50 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 Aug 20 06:43:50 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee169a11-7028-4b92-b87a-a54901393140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7188df56-7e7c-4e8f-a002-1525350659d8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febb8806-b2cc-45e5-a4c1-a26356485a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:50 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Volume volume-7188df56-7e7c-4e8f-a002-1525350659d8 (7188df56-7e7c-4e8f-a002-1525350659d8): created successfully Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febb8806-b2cc-45e5-a4c1-a26356485a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Flow 'volume_create_manager' (255e0a35-63f0-4ded-bfff-c172a0df5f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4161018d-2876-4b7f-94ac-4f1f997d1cf1 tempest-VolumeQuotasAdminTestJSON-170118115 None] Created volume successfully. Aug 20 06:43:50 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9" returned: 0 in 0.856s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:50 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9 Aug 20 06:43:50 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (bb8f3656-4f9a-4b60-ae3f-5fdcc1552be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad02143-6af1-40cd-aafb-4548a1e1e905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad02143-6af1-40cd-aafb-4548a1e1e905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-495448817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f82d745-68ce-4a12-add5-a490871fe0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:51Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b220638-7943-40c7-90d4-c84f436a599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b220638-7943-40c7-90d4-c84f436a599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc8ec2-43d8-43ab-8b1e-f097c3f3d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc8ec2-43d8-43ab-8b1e-f097c3f3d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f82d745-68ce-4a12-add5-a490871fe0fe', 'volume_name': 'volume-2f82d745-68ce-4a12-add5-a490871fe0fe', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514964a5-a6cc-4bea-b98f-5bbb2d634c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514964a5-a6cc-4bea-b98f-5bbb2d634c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca07fee-1efd-401a-8d40-4c1d36eb2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Volume 2f82d745-68ce-4a12-add5-a490871fe0fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f82d745-68ce-4a12-add5-a490871fe0fe', 'volume_size': 1} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-495448817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f82d745-68ce-4a12-add5-a490871fe0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:51Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Creating volume 2f82d745-68ce-4a12-add5-a490871fe0fe {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:51 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:51 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe 1073741824 Aug 20 06:43:51 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:51 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dd110395-8de4-4521-be13-15ee86a616f9" returned: 0 in 0.480s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-quobyte-dd110395-8de4-4521-be13-15ee86a616f9" released by "delete_volume" :: held 1.441s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:51 devstack cinder-volume[94234]: WARNING cinder.quota [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101568738-372285916 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101568738-372285916, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:51 devstack cinder-volume[94234]: WARNING cinder.quota [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101568738-372285916 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101568738-372285916, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Created reservations ['7f3c508d-29f9-4639-bc6c-fda0d861cc67', '7d55ce17-aaa3-42b0-aa82-4f184fa1aab8', '2cb2a8d5-58f6-49d3-9386-9b1877b6c311', 'd0856058-7b7b-49a6-8090-bef638d0dd84'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:51 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:51 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:51 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:51 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Deleted volume successfully. Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6c298cd2-69fe-4043-9d62-90f820f1d8e7 tempest-TestInstancesWithCinderVolumes-436088650 None] Lock "cinder-dd110395-8de4-4521-be13-15ee86a616f9-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:52 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe 1073741824" returned: 0 in 0.974s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-069e543c-849c-4e78-b54d-e211405c1592 tempest-VolumeQuotasAdminTestJSON-2134611056 None] Transfer volume completed successfully. Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:52 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe Aug 20 06:43:52 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:52 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe" returned: 0 in 0.521s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca07fee-1efd-401a-8d40-4c1d36eb2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f82d745-68ce-4a12-add5-a490871fe0fe', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16059e86-6f8b-4cc0-a3a4-776e7436c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Volume volume-2f82d745-68ce-4a12-add5-a490871fe0fe (2f82d745-68ce-4a12-add5-a490871fe0fe): created successfully Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16059e86-6f8b-4cc0-a3a4-776e7436c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (bb8f3656-4f9a-4b60-ae3f-5fdcc1552be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2349428b-26a3-4739-bc32-d09485c715aa tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c21345c1-40e4-4e51-bd29-8b419ab1af2b tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe" by "attach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c21345c1-40e4-4e51-bd29-8b419ab1af2b tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe" acquired by "attach_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Acquiring lock "cinder-7188df56-7e7c-4e8f-a002-1525350659d8-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "cinder-7188df56-7e7c-4e8f-a002-1525350659d8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c21345c1-40e4-4e51-bd29-8b419ab1af2b tempest-VolumesActionsTest-1301434826 None] Attaching volume 2f82d745-68ce-4a12-add5-a490871fe0fe to instance 0855fa3a-444d-45b6-b7a6-9c692cdedb67 at mountpoint /dev/vdb on host None. Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Acquiring lock "cinder-quobyte-7188df56-7e7c-4e8f-a002-1525350659d8" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "cinder-quobyte-7188df56-7e7c-4e8f-a002-1525350659d8" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c21345c1-40e4-4e51-bd29-8b419ab1af2b tempest-VolumesActionsTest-1301434826 None] Attach volume completed successfully. Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c21345c1-40e4-4e51-bd29-8b419ab1af2b tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe" released by "attach_volume" :: held 0.320s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a077d7d-1c96-4d8f-b1e9-e317388d3550]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:53 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 Aug 20 06:43:53 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:54 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8" returned: 0 in 0.626s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:54 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8 Aug 20 06:43:54 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:54 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7188df56-7e7c-4e8f-a002-1525350659d8" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "cinder-quobyte-7188df56-7e7c-4e8f-a002-1525350659d8" released by "delete_volume" :: held 1.122s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Created reservations ['c1ba90a6-4619-4224-a570-58b80e0ee775', '4638ef12-a8d6-4858-95a9-3c1733c657c3', '3b674b63-1d40-4202-9f5e-0267289f6c95', '2f3545df-a061-4022-aa20-e2f2897680d4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Terminate volume connection completed successfully. Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" by "detach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:54 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:54 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Detaching volume 2f82d745-68ce-4a12-add5-a490871fe0fe from instance 0855fa3a-444d-45b6-b7a6-9c692cdedb67. Aug 20 06:43:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Detach volume completed successfully. Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ef8a572c-b3ca-44c4-a78a-fb3f9b070936 tempest-VolumesActionsTest-163096811 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:55 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.538s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Deleted volume successfully. Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2ed7ac88-f7a4-4107-827c-0bc0deb8b537 tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" by "detach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-366836e8-b80e-4d5e-91c1-4b685f9e691b tempest-VolumeQuotasAdminTestJSON-747767313 None] Lock "cinder-7188df56-7e7c-4e8f-a002-1525350659d8-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2ed7ac88-f7a4-4107-827c-0bc0deb8b537 tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2ed7ac88-f7a4-4107-827c-0bc0deb8b537 tempest-VolumesActionsTest-1301434826 None] Volume detach called, but volume not attached. Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2ed7ac88-f7a4-4107-827c-0bc0deb8b537 tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-quobyte-2f82d745-68ce-4a12-add5-a490871fe0fe" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "cinder-quobyte-2f82d745-68ce-4a12-add5-a490871fe0fe" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad539c50-6101-44c5-8556-0d7a081a8965]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:56 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe Aug 20 06:43:56 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:56 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe" returned: 0 in 0.699s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:56 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe Aug 20 06:43:56 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:57 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f82d745-68ce-4a12-add5-a490871fe0fe" returned: 0 in 0.471s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "cinder-quobyte-2f82d745-68ce-4a12-add5-a490871fe0fe" released by "delete_volume" :: held 1.245s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Created reservations ['6a531ef3-c99f-42b4-b95f-a91f51d56c19', 'bfda02af-3164-4644-bcbc-c39c00a10aa9', 'd547f4df-1fcd-4713-bf58-2c4fd603b75b', '3f14ed41-d1fb-4ca1-a95a-819ba09e416c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:57 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:43:57 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Flow 'volume_create_manager' (cabe00da-6dbc-47fc-82ea-0ad96626170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69c06a-916d-452b-b6a3-9af5d002a1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69c06a-916d-452b-b6a3-9af5d002a1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-684640510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6442acf-19c0-43b6-a39b-2d8db8f0664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d367a1a3c547e9a6024f33e5e602e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:58Z,use_quota=True,user_id='18a3072a1d674be99bd3a752b32f2a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f561c65-0a78-4a64-9057-741e70e4361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f561c65-0a78-4a64-9057-741e70e4361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88458abc-9595-4848-9662-6f8a8fb0682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88458abc-9595-4848-9662-6f8a8fb0682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6442acf-19c0-43b6-a39b-2d8db8f0664f', 'volume_name': 'volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05d99cf-bbc3-4df1-8189-530f619727cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05d99cf-bbc3-4df1-8189-530f619727cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fea350-544a-4ada-99e3-447a6d35c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:58 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Volume a6442acf-19c0-43b6-a39b-2d8db8f0664f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f', 'volume_size': 1} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-684640510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6442acf-19c0-43b6-a39b-2d8db8f0664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d367a1a3c547e9a6024f33e5e602e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:43:58Z,use_quota=True,user_id='18a3072a1d674be99bd3a752b32f2a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Creating volume a6442acf-19c0-43b6-a39b-2d8db8f0664f {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:43:58 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:58 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f 1073741824 Aug 20 06:43:58 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:58 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.705s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:43:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Deleted volume successfully. Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4fd446b8-429d-4b4d-a4de-7e9643f7427c tempest-VolumesActionsTest-1301434826 None] Lock "cinder-2f82d745-68ce-4a12-add5-a490871fe0fe-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:43:58 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f 1073741824" returned: 0 in 0.856s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:43:58 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f Aug 20 06:43:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:43:59 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f" returned: 0 in 0.390s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fea350-544a-4ada-99e3-447a6d35c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6003a56-63bd-4b3f-8a32-fea3652c513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:43:59 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Volume volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f (a6442acf-19c0-43b6-a39b-2d8db8f0664f): created successfully Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6003a56-63bd-4b3f-8a32-fea3652c513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:43:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Flow 'volume_create_manager' (cabe00da-6dbc-47fc-82ea-0ad96626170d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:43:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-48733d1a-afd5-429b-8a1b-985b89b3ce1d tempest-VolumesServicesTestJSON-1590101789 None] Created volume successfully. Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Acquiring lock "cinder-a6442acf-19c0-43b6-a39b-2d8db8f0664f-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "cinder-a6442acf-19c0-43b6-a39b-2d8db8f0664f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Acquiring lock "cinder-quobyte-a6442acf-19c0-43b6-a39b-2d8db8f0664f" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "cinder-quobyte-a6442acf-19c0-43b6-a39b-2d8db8f0664f" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334fd73-8d45-4d93-8afb-1f96802ce2b1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:00 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f Aug 20 06:44:00 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:00 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f" returned: 0 in 0.589s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:01 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f Aug 20 06:44:01 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:01 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6442acf-19c0-43b6-a39b-2d8db8f0664f" returned: 0 in 0.426s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "cinder-quobyte-a6442acf-19c0-43b6-a39b-2d8db8f0664f" released by "delete_volume" :: held 1.070s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Created reservations ['a834c9cf-2c14-412e-b19f-701772cfa18f', 'ffb03e1b-4bf8-403f-ae4f-720f6e3101f9', '33ac766d-38de-4821-b43b-c8a4de378c46', '174e2295-7d54-4f78-bf3d-14c4fed2e85f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:01 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:01 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:02 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:02 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Deleted volume successfully. Aug 20 06:44:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0dfe3467-f3f2-40b2-9d04-c6dd7429605b tempest-VolumesServicesTestJSON-1590101789 None] Lock "cinder-a6442acf-19c0-43b6-a39b-2d8db8f0664f-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (94d43166-98fc-4b3c-8b34-c7462ca1f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54311afe-1180-4cbc-bb56-b61c6e41369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54311afe-1180-4cbc-bb56-b61c6e41369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1185317074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:03Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c56737-c692-4760-84de-3ac01749e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c56737-c692-4760-84de-3ac01749e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e163dd6b-480e-404f-9373-86948bfb8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e163dd6b-480e-404f-9373-86948bfb8660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb', 'volume_name': 'volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53febe70-c442-4bcc-ad7d-bc330d98e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53febe70-c442-4bcc-ad7d-bc330d98e56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411db231-f283-4287-b04d-b339ecd51cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:03 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Volume 2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb', 'volume_size': 1} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1185317074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:03Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Creating volume 2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:03 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:03 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb 1073741824 Aug 20 06:44:03 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:03 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb 1073741824" returned: 0 in 0.631s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:04 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb Aug 20 06:44:04 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:04 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" returned: 0 in 0.381s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411db231-f283-4287-b04d-b339ecd51cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792a5e56-2e5a-4223-be18-bc22a9c4e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:04 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Volume volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb (2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb): created successfully Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792a5e56-2e5a-4223-be18-bc22a9c4e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (94d43166-98fc-4b3c-8b34-c7462ca1f554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-90717bbf-b2e7-4b06-9747-f6f597c1561a tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "cinder-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-quobyte-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2f8bc-e34b-4c12-8254-ce47754199d8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:05 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb Aug 20 06:44:05 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:06 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" returned: 0 in 0.451s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:06 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb Aug 20 06:44:06 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:06 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" returned: 0 in 0.409s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb" released by "delete_volume" :: held 0.914s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Created reservations ['c65d56e7-7b85-4e7f-995c-341f4e34ba44', '1d860d3f-6dc8-49f6-a240-6d13fc0742e4', 'a38a81fc-c1ff-461c-b38e-220e855a5747', '6aa27a00-a99b-424a-ab45-169f1aa25117'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:06 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:06 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:06 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:06 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Flow 'volume_create_manager' (ace53171-b6f3-4b7f-b40b-aec39e24a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7de352-37ea-488d-b016-9c6a6aa280cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7de352-37ea-488d-b016-9c6a6aa280cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1767020815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c9c5a7-220d-47bf-b5ac-573704154877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb75723e399407c8eb63d540eb76572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:07Z,use_quota=True,user_id='b5bead1304a04a2e9e51f599f3b1528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adc735-7669-4895-a3ae-d29af62887ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adc735-7669-4895-a3ae-d29af62887ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed212d8d-d33a-4279-9acb-0026270c6aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed212d8d-d33a-4279-9acb-0026270c6aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c9c5a7-220d-47bf-b5ac-573704154877', 'volume_name': 'volume-49c9c5a7-220d-47bf-b5ac-573704154877', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4846170a-de2e-47e6-86f6-daf6bbc3b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4846170a-de2e-47e6-86f6-daf6bbc3b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6943ef48-584e-4d43-b4e6-ea876e1288e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Volume 49c9c5a7-220d-47bf-b5ac-573704154877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c9c5a7-220d-47bf-b5ac-573704154877', 'volume_size': 1} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1767020815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c9c5a7-220d-47bf-b5ac-573704154877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb75723e399407c8eb63d540eb76572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:07Z,use_quota=True,user_id='b5bead1304a04a2e9e51f599f3b1528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Creating volume 49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:07 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Deleted volume successfully. Aug 20 06:44:07 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 1073741824 Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-12c2272d-beb8-488f-93e0-aab76bd77081 tempest-VolumesActionsTest-163096811 None] Lock "cinder-2198b3a8-4cd3-4bb2-90e0-a2a58b3ab5cb-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:07 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:07 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 1073741824" returned: 0 in 0.572s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:07 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 Aug 20 06:44:07 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:08 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877" returned: 0 in 0.346s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6943ef48-584e-4d43-b4e6-ea876e1288e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c9c5a7-220d-47bf-b5ac-573704154877', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460d46d0-bc5a-42d8-ad4e-2297dc3a5e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Volume volume-49c9c5a7-220d-47bf-b5ac-573704154877 (49c9c5a7-220d-47bf-b5ac-573704154877): created successfully Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460d46d0-bc5a-42d8-ad4e-2297dc3a5e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Flow 'volume_create_manager' (ace53171-b6f3-4b7f-b40b-aec39e24a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-16359f81-13ff-4b4c-8007-9d98c9deb01b tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Created volume successfully. Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (43e48476-64e5-4d2a-836a-caf789bd97f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f537e4f-5379-4f2b-b28e-22a67d0e4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f537e4f-5379-4f2b-b28e-22a67d0e4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041710819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af8532e-e1a0-46bd-8ff3-a7b9544c27c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:08Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff4149-75ac-40cf-95e8-8889827b6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff4149-75ac-40cf-95e8-8889827b6378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a434b18f-fa9f-46f7-b8c2-fee585884a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a434b18f-fa9f-46f7-b8c2-fee585884a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af8532e-e1a0-46bd-8ff3-a7b9544c27c5', 'volume_name': 'volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fa2680-2b67-4d37-8fd6-2ba95445d884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fa2680-2b67-4d37-8fd6-2ba95445d884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6794eb-1b5d-460c-9125-5769c5571119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Volume 5af8532e-e1a0-46bd-8ff3-a7b9544c27c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5', 'volume_size': 1} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041710819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af8532e-e1a0-46bd-8ff3-a7b9544c27c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:08Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Creating volume 5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:08 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:08 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 1073741824 Aug 20 06:44:08 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:09 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 1073741824" returned: 0 in 0.590s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:09 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 Aug 20 06:44:09 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:09 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.106s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6794eb-1b5d-460c-9125-5769c5571119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6b1c19-7281-4dc4-a393-fd1b903b75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Creating offline snapshot 412b59eb-43d0-4dfd-b944-20ba08cc4cf9 of volume 49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:44:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Volume volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 (5af8532e-e1a0-46bd-8ff3-a7b9544c27c5): created successfully Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6b1c19-7281-4dc4-a393-fd1b903b75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (43e48476-64e5-4d2a-836a-caf789bd97f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa919834-4ed7-4f8f-b7e5-f7bdb36ce951]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0a9acd1f-1a22-43cc-832f-8d19d9c4f4a6 tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:44:09 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 Aug 20 06:44:09 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:09 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877" returned: 0 in 0.439s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:10 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 1G Aug 20 06:44:10 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:10 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 1G" returned: 0 in 0.461s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c9c5a7-220d-47bf-b5ac-573704154877 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:10 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c9c5a7-220d-47bf-b5ac-573704154877 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 Aug 20 06:44:10 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "cinder-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=117,cinder:INSERT=37,cinder:UPDATE=134,cinder:DELETE=9 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:44:10 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=112,cinder:UPDATE=149,cinder:INSERT=27,cinder:DELETE=9 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c9c5a7-220d-47bf-b5ac-573704154877 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9" returned: 0 in 0.412s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:10 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 is being set with open permissions: ugo+rw Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:10 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 Aug 20 06:44:10 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-quobyte-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09b918-3f46-44fd-a674-5c154399a42f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Flow 'volume_create_manager' (d17c77d8-8352-4333-8183-17a2e058a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b05a7-8f73-492c-abfb-e6e8acb97c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b05a7-8f73-492c-abfb-e6e8acb97c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582045414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1b2881-dea5-4879-afda-ef31bf43dbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc97247507f14f5684f0606284999bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:11Z,use_quota=True,user_id='edb54e4220cc4b3dbabee59bf8d15e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dde6ee0d-e84f-4a58-8f8f-bb2192853fc3),volume_type_id=dde6ee0d-e84f-4a58-8f8f-bb2192853fc3)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e5480-7562-461c-8462-849d0c3eba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:11 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 Aug 20 06:44:11 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e5480-7562-461c-8462-849d0c3eba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0094fef2-081d-49a2-b7ac-49f95fafcbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0094fef2-081d-49a2-b7ac-49f95fafcbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1b2881-dea5-4879-afda-ef31bf43dbe0', 'volume_name': 'volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4253ce8c-b403-4983-8db9-eb7dada44c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4253ce8c-b403-4983-8db9-eb7dada44c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42316ca3-e643-427c-95c6-8f5af9710b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:11 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Volume 7b1b2881-dea5-4879-afda-ef31bf43dbe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0', 'volume_size': 1} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:11 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9" returned: 0 in 0.329s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:11 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info Aug 20 06:44:11 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:11 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" returned: 0 in 0.454s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:11 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5 Aug 20 06:44:11 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:11 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info" returned: 0 in 0.284s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:11 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info is being set with open permissions: ugo+rw Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:11 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info Aug 20 06:44:11 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:11 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" returned: 0 in 0.304s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5" released by "delete_volume" :: held 0.819s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:11 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.info" returned: 0 in 0.293s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582045414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1b2881-dea5-4879-afda-ef31bf43dbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc97247507f14f5684f0606284999bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:11Z,use_quota=True,user_id='edb54e4220cc4b3dbabee59bf8d15e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dde6ee0d-e84f-4a58-8f8f-bb2192853fc3),volume_type_id=dde6ee0d-e84f-4a58-8f8f-bb2192853fc3)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Creating volume 7b1b2881-dea5-4879-afda-ef31bf43dbe0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:11 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:11 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 1073741824 Aug 20 06:44:11 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:11 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Created reservations ['12ecb97a-e572-4454-b3e2-3cf9ff78c16a', 'c75c2f7d-6314-4c65-8e58-1e650f22c66a', '942ffc6c-e25a-48b4-8297-4e4bec4b995e', 'a47c92f7-6a2f-467c-91ce-c3dc815e3ecf'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-100cc75b-def0-4adc-8c32-3ad02077f446 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Create snapshot completed successfully Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:12 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:12 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:12 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.303s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Deleted volume successfully. Aug 20 06:44:12 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 1073741824" returned: 0 in 0.531s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4d96ceb-2168-4b49-b903-da01317abab6 tempest-VolumesActionsTest-163096811 None] Lock "cinder-5af8532e-e1a0-46bd-8ff3-a7b9544c27c5-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:12 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 Aug 20 06:44:12 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:12 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42316ca3-e643-427c-95c6-8f5af9710b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72941762-ea72-43b8-b6dc-62763dd43b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:12 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Volume volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 (7b1b2881-dea5-4879-afda-ef31bf43dbe0): created successfully Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72941762-ea72-43b8-b6dc-62763dd43b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Flow 'volume_create_manager' (d17c77d8-8352-4333-8183-17a2e058a859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-944320cb-4795-4942-87d2-8d7a17c9f032 tempest-VolumeTypesAccessTest-657077719 None] Created volume successfully. Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "cinder-412b59eb-43d0-4dfd-b944-20ba08cc4cf9-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-412b59eb-43d0-4dfd-b944-20ba08cc4cf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "cinder-quobyte-412b59eb-43d0-4dfd-b944-20ba08cc4cf9" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-412b59eb-43d0-4dfd-b944-20ba08cc4cf9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Deleting offline snapshot 412b59eb-43d0-4dfd-b944-20ba08cc4cf9 of volume 49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] snapshot_file for this snap is: volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca8b3c-b8e6-4919-8522-8b8a78730201]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Acquiring lock "cinder-7b1b2881-dea5-4879-afda-ef31bf43dbe0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:13 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "cinder-7b1b2881-dea5-4879-afda-ef31bf43dbe0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:13 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Acquiring lock "cinder-quobyte-7b1b2881-dea5-4879-afda-ef31bf43dbe0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "cinder-quobyte-7b1b2881-dea5-4879-afda-ef31bf43dbe0" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6099ca1-71d0-4777-adaf-0d8292034c70]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:13 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 Aug 20 06:44:13 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:13 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9" returned: 0 in 0.538s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49c9c5a7-220d-47bf-b5ac-573704154877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eabda6a-5be7-4a5b-a105-9c226ede37e2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (68d6ac1e-9e3f-43b3-9f67-5b46a381c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a88ead7-77c6-4cab-9e9d-f3b70a3f70f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a88ead7-77c6-4cab-9e9d-f3b70a3f70f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44258541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936d03e2-3957-4e3e-b909-54f9a9f44111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:14Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c77149-0ea8-403a-ac44-b3bc0c8bf5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c77149-0ea8-403a-ac44-b3bc0c8bf5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59394ff-fe3c-4d4d-a424-edf537ad895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:13 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 Aug 20 06:44:13 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59394ff-fe3c-4d4d-a424-edf537ad895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936d03e2-3957-4e3e-b909-54f9a9f44111', 'volume_name': 'volume-936d03e2-3957-4e3e-b909-54f9a9f44111', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a37cb9-4873-4361-80b8-a89761548b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a37cb9-4873-4361-80b8-a89761548b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763925d-e27b-41ae-a596-a299f9f9afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Volume 936d03e2-3957-4e3e-b909-54f9a9f44111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936d03e2-3957-4e3e-b909-54f9a9f44111', 'volume_size': 1} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44258541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936d03e2-3957-4e3e-b909-54f9a9f44111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:14Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Creating volume 936d03e2-3957-4e3e-b909-54f9a9f44111 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:13 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:13 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0" returned: 0 in 0.502s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:13 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 1073741824 Aug 20 06:44:13 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:13 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0 Aug 20 06:44:13 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:14 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877" returned: 0 in 0.497s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:14 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 Aug 20 06:44:14 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:14 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7b1b2881-dea5-4879-afda-ef31bf43dbe0" returned: 0 in 0.312s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "cinder-quobyte-7b1b2881-dea5-4879-afda-ef31bf43dbe0" released by "delete_volume" :: held 0.867s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:14 devstack cinder-volume[94234]: WARNING cinder.quota [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-73822076 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-73822076, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:44:14 devstack cinder-volume[94234]: WARNING cinder.quota [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-73822076 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-73822076, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Created reservations ['432a299f-3650-433d-8047-56b4024fcd3e', '502a74a0-b332-4d55-8a3d-04ed7c03d304', '4a742916-1af7-4d47-b3fc-c0223cb03974', '685a071a-51af-4c29-bc5f-922503cdab3d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:14 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 1073741824" returned: 0 in 0.570s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:14 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:14 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 Aug 20 06:44:14 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:14 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9" returned: 0 in 0.465s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:14 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9 Aug 20 06:44:14 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:14 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.354s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Deleted volume successfully. Aug 20 06:44:14 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8c8331d-54b0-4957-8b12-dc97ca74ac40 tempest-VolumeTypesAccessTest-657077719 None] Lock "cinder-7b1b2881-dea5-4879-afda-ef31bf43dbe0-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111" returned: 0 in 0.347s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763925d-e27b-41ae-a596-a299f9f9afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936d03e2-3957-4e3e-b909-54f9a9f44111', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3ab475-290a-43b5-9f45-4ad3ffa6e216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Volume volume-936d03e2-3957-4e3e-b909-54f9a9f44111 (936d03e2-3957-4e3e-b909-54f9a9f44111): created successfully Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3ab475-290a-43b5-9f45-4ad3ffa6e216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (68d6ac1e-9e3f-43b3-9f67-5b46a381c485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-df14f8f9-0a5e-4ce2-91df-f1c08657b14b tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:44:14 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877.412b59eb-43d0-4dfd-b944-20ba08cc4cf9" returned: 0 in 0.333s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-412b59eb-43d0-4dfd-b944-20ba08cc4cf9" released by "_delete_snapshot" :: held 1.981s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" released by "delete_snapshot" :: held 2.020s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:15 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Created reservations ['ab8c7af0-7c20-4377-88c9-b7726d5dd77d', '64d6309e-dba9-484c-a995-1ae958ffbd11', '4b6ac824-0a90-40fe-9e20-377dce321b96', '81162256-b647-4c30-a0e8-3989ab319ef0'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Delete snapshot completed successfully. Aug 20 06:44:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bf32566-d784-4258-8f26-a67cf97a3af9 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-412b59eb-43d0-4dfd-b944-20ba08cc4cf9-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-936d03e2-3957-4e3e-b909-54f9a9f44111-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "cinder-936d03e2-3957-4e3e-b909-54f9a9f44111-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-quobyte-936d03e2-3957-4e3e-b909-54f9a9f44111" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "cinder-49c9c5a7-220d-47bf-b5ac-573704154877-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-936d03e2-3957-4e3e-b909-54f9a9f44111" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-49c9c5a7-220d-47bf-b5ac-573704154877-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b34f4b-8035-4c51-8231-c2f3e8618d12]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2593631-2d58-47f2-b590-61b837ca628f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:16 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 Aug 20 06:44:16 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:16 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 Aug 20 06:44:16 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:16 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111" returned: 0 in 0.549s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:16 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111 Aug 20 06:44:16 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:17 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877" returned: 0 in 0.561s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:17 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877 Aug 20 06:44:17 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:17 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-936d03e2-3957-4e3e-b909-54f9a9f44111" returned: 0 in 0.397s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-936d03e2-3957-4e3e-b909-54f9a9f44111" released by "delete_volume" :: held 1.033s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:17 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-49c9c5a7-220d-47bf-b5ac-573704154877" returned: 0 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-quobyte-49c9c5a7-220d-47bf-b5ac-573704154877" released by "delete_volume" :: held 1.018s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Created reservations ['d6a7950e-ea61-45e4-8d82-c7f6d3055e7d', '1215aeec-eabd-4c3a-a97f-c880ca8cac39', '3587d958-4a1a-4bf6-9509-7071729c7dd7', '7af66958-e2e5-4cd6-a3c2-a915dfe0b888'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Created reservations ['a76f31ce-b282-443e-bf09-9297fca7e5fb', 'd1eac3fe-947c-4492-b17b-d42493806b13', '22cf29cd-5bee-463f-b30d-77fbaa86c119', '1b3d57f5-2377-44d6-9745-499f94c837aa'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:17 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:17 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:17 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:17 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:17 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.359s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:17 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Deleted volume successfully. Aug 20 06:44:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18dd9d27-f4a6-4afe-b7a3-a3ab76440a32 tempest-VolumesActionsTest-163096811 None] Lock "cinder-936d03e2-3957-4e3e-b909-54f9a9f44111-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:18 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.320s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:18 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:18 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Deleted volume successfully. Aug 20 06:44:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a1312220-95a8-435a-a7c5-52c0fc904419 tempest-VolumeSnapshotQuotasNegativeTestJSON-762993395 None] Lock "cinder-49c9c5a7-220d-47bf-b5ac-573704154877-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (dfd7508e-c1ff-4b7f-821c-1fa0b734b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90fdc68-b5ba-44b9-864d-ca950a7ce3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90fdc68-b5ba-44b9-864d-ca950a7ce3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519353895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6823601-8c74-47c4-97a3-4a3f46dff0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:19Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d3d532-bccf-4a61-bcb4-88b4a031d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d3d532-bccf-4a61-bcb4-88b4a031d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f480e4-af12-498f-b650-182705ac5244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f480e4-af12-498f-b650-182705ac5244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6823601-8c74-47c4-97a3-4a3f46dff0ce', 'volume_name': 'volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07764253-b77a-4f6b-a394-9f43a3da8919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07764253-b77a-4f6b-a394-9f43a3da8919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6dc6d9-5f98-402d-8bc1-c3e4e6842aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Volume c6823601-8c74-47c4-97a3-4a3f46dff0ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce', 'volume_size': 1} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519353895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6823601-8c74-47c4-97a3-4a3f46dff0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:19Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Creating volume c6823601-8c74-47c4-97a3-4a3f46dff0ce {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:19 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:19 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce 1073741824 Aug 20 06:44:19 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:20 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce 1073741824" returned: 0 in 0.640s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:20 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce Aug 20 06:44:20 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:20 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce" returned: 0 in 0.324s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6dc6d9-5f98-402d-8bc1-c3e4e6842aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2233c4ff-10d9-44d7-8d4c-6939568a22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Volume volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce (c6823601-8c74-47c4-97a3-4a3f46dff0ce): created successfully Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2233c4ff-10d9-44d7-8d4c-6939568a22c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (dfd7508e-c1ff-4b7f-821c-1fa0b734b84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e9cc4444-2c5b-44fe-8b87-dcd5189b725c tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-c6823601-8c74-47c4-97a3-4a3f46dff0ce-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "cinder-c6823601-8c74-47c4-97a3-4a3f46dff0ce-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Acquiring lock "cinder-quobyte-c6823601-8c74-47c4-97a3-4a3f46dff0ce" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-c6823601-8c74-47c4-97a3-4a3f46dff0ce" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bad8a4-5339-40bc-be5d-4f3ae2a049fd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:22 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce Aug 20 06:44:22 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:22 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce" returned: 0 in 0.525s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:22 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce Aug 20 06:44:22 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:22 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c6823601-8c74-47c4-97a3-4a3f46dff0ce" returned: 0 in 0.397s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "cinder-quobyte-c6823601-8c74-47c4-97a3-4a3f46dff0ce" released by "delete_volume" :: held 0.998s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:22 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Created reservations ['69ec2ce5-4038-4347-9f5e-76a6697b8d2d', '7a7c7b42-b89f-4f6f-9a73-ed0278e20792', 'a544ece6-9b26-4f1e-b2f5-f3273a7c8740', 'ee7c2f77-3d43-4120-b7a2-a01f14c6d2cb'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:23 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:23 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:23 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Deleted volume successfully. Aug 20 06:44:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cfd519a-89e8-4f61-aabb-cb061ef39ed0 tempest-VolumesActionsTest-163096811 None] Lock "cinder-c6823601-8c74-47c4-97a3-4a3f46dff0ce-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (a296d845-d1a6-446c-98e1-4ac934cff1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27e1392-69e3-4dd5-afcf-11a2cb1c6f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27e1392-69e3-4dd5-afcf-11a2cb1c6f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683252446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:25Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b456fa2-d248-4ea5-b0a7-49cdb0bcc7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b456fa2-d248-4ea5-b0a7-49cdb0bcc7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92499d0-ba0b-4edb-9dac-9c68a5072233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92499d0-ba0b-4edb-9dac-9c68a5072233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398', 'volume_name': 'volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331e941-e971-4fae-b172-0271b1507ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331e941-e971-4fae-b172-0271b1507ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e1da5-bebf-48b7-bae5-00a797506fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Volume b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398', 'volume_size': 1} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683252446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ec311e1bf840a9aeba3e063f7e5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:25Z,use_quota=True,user_id='e4e3910bba1e43989769e6bca60b4bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Creating volume b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:24 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 1073741824 Aug 20 06:44:24 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:25 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 1073741824" returned: 0 in 0.652s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:25 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 Aug 20 06:44:25 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:25 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e1da5-bebf-48b7-bae5-00a797506fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a3dfe9-2958-44c9-86ac-9dd1fa2d5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:26 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Volume volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 (b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398): created successfully Aug 20 06:44:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a3dfe9-2958-44c9-86ac-9dd1fa2d5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Flow 'volume_create_manager' (a296d845-d1a6-446c-98e1-4ac934cff1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a3cca205-0f18-452a-967b-2090ae24b035 tempest-VolumesActionsTest-1301434826 None] Created volume successfully. Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "cinder-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Acquiring lock "cinder-quobyte-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "cinder-quobyte-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a18f6b-2684-417c-892f-59336b34509e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:27 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 Aug 20 06:44:27 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:28 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" returned: 0 in 0.518s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:28 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398 Aug 20 06:44:28 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:28 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" returned: 0 in 0.335s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "cinder-quobyte-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398" released by "delete_volume" :: held 0.918s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Created reservations ['bcd26615-3679-4551-b384-c7622743ad77', '0b93ce6d-00b7-4dc3-8b0e-043f7f5f5b5e', 'e1b31e8e-7e67-46a0-9870-401cc58b6ff7', '7431d714-ab4f-4753-bd1e-eda87c19e441'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:28 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:28 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:29 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:29 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Deleted volume successfully. Aug 20 06:44:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b7fdb140-4791-4774-ae61-c2a383dac4ad tempest-VolumesActionsTest-1301434826 None] Lock "cinder-b14a2b4f-b176-4b2f-82eb-f6b7ac1d5398-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Flow 'volume_create_manager' (a7156ca9-28fd-4a00-8518-fde72e497480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d02dcc-a25d-44ad-b2a8-a78f97b74fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d02dcc-a25d-44ad-b2a8-a78f97b74fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-599867094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82cd840-8284-479e-969e-04f71b56f576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c0815e213646b8ad05be5857c38f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:31Z,use_quota=True,user_id='4e23b2c17f1c4038b6ee48a1afe4fb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0e9298-9dc6-4cc6-a4c3-0c6d1e1b4e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0e9298-9dc6-4cc6-a4c3-0c6d1e1b4e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8170649e-2a99-4ac4-924c-0ea3d9fdfbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:30 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8170649e-2a99-4ac4-924c-0ea3d9fdfbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b82cd840-8284-479e-969e-04f71b56f576', 'volume_name': 'volume-b82cd840-8284-479e-969e-04f71b56f576', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a67d34-6435-41a8-b02a-b26b7ecf08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a67d34-6435-41a8-b02a-b26b7ecf08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707cecd4-3a3a-4f23-a9c5-7a9ad82b9fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Volume b82cd840-8284-479e-969e-04f71b56f576: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b82cd840-8284-479e-969e-04f71b56f576', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Trying to clone b82cd840-8284-479e-969e-04f71b56f576 from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:44:31 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Image download 20.69 MB at 20.69 MB/s Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ef523-5c2e-4976-b663-9ee47fe61acf]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:31 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD Aug 20 06:44:31 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:32 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 is fetched for user 4e23b2c17f1c4038b6ee48a1afe4fb19. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970f618-6970-4ebc-9f79-2d566e078014]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:32 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD Aug 20 06:44:32 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:32 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-599867094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82cd840-8284-479e-969e-04f71b56f576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c0815e213646b8ad05be5857c38f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:31Z,use_quota=True,user_id='4e23b2c17f1c4038b6ee48a1afe4fb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Creating volume b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:32 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:32 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1073741824 Aug 20 06:44:32 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:33 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1073741824" returned: 0 in 0.556s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:33 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 Aug 20 06:44:33 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:33 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576" returned: 0 in 0.315s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Attempting download of d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume b82cd840-8284-479e-969e-04f71b56f576. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac60e4-1414-49f1-8368-0c9ea1d4fc69]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:33 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn Aug 20 06:44:33 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:34 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:34 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn Aug 20 06:44:34 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:34 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn" returned: 1 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_21je94zn' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2618c746-815a-4a05-a415-21677a787f9f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:34 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:34 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:34 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD Aug 20 06:44:34 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:34 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.376s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:44:34 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:44:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:34 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 Aug 20 06:44:34 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:37 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576" returned: 0 in 2.564s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:37 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wgs2eswmdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:44:37 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Converted 112.00 MB image at 43.66 MB/s Aug 20 06:44:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:37 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1G Aug 20 06:44:37 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:38 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 1G" returned: 0 in 0.612s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Downloaded image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume b82cd840-8284-479e-969e-04f71b56f576 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 for user 4e23b2c17f1c4038b6ee48a1afe4fb19 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Marking volume b82cd840-8284-479e-969e-04f71b56f576 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Copying metadata from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 to b82cd840-8284-479e-969e-04f71b56f576. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Creating volume glance metadata for volume b82cd840-8284-479e-969e-04f71b56f576 backed by image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707cecd4-3a3a-4f23-a9c5-7a9ad82b9fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82cd840-8284-479e-969e-04f71b56f576', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e5360-686e-4e62-8763-5bfac7edab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Volume volume-b82cd840-8284-479e-969e-04f71b56f576 (b82cd840-8284-479e-969e-04f71b56f576): created successfully Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e5360-686e-4e62-8763-5bfac7edab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Flow 'volume_create_manager' (a7156ca9-28fd-4a00-8518-fde72e497480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5db21a84-4694-4268-a033-ccc84de0c3eb tempest-VolumesImageMetadata-873229035 None] Created volume successfully. Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Acquiring lock "cinder-b82cd840-8284-479e-969e-04f71b56f576-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "cinder-b82cd840-8284-479e-969e-04f71b56f576-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Acquiring lock "cinder-quobyte-b82cd840-8284-479e-969e-04f71b56f576" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "cinder-quobyte-b82cd840-8284-479e-969e-04f71b56f576" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d210aa-1ec1-4399-a9bf-dd25046ddb09]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:39 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 Aug 20 06:44:39 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:40 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576" returned: 0 in 0.382s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:40 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576 Aug 20 06:44:40 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:40 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b82cd840-8284-479e-969e-04f71b56f576" returned: 0 in 0.323s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "cinder-quobyte-b82cd840-8284-479e-969e-04f71b56f576" released by "delete_volume" :: held 0.756s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Created reservations ['440a1207-0744-44dd-aed5-c69810eeea82', '3dcd4db9-5a95-4fba-88c0-c2b644399138', '39105674-149a-48c3-9a42-e1509adf1d95', '6e7f4671-64b4-4102-8f04-af01709738f3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:40 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:40 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:41 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.307s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:41 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Deleted volume successfully. Aug 20 06:44:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-941a0d57-e541-4a04-8602-e857a27cf9ae tempest-VolumesImageMetadata-873229035 None] Lock "cinder-b82cd840-8284-479e-969e-04f71b56f576-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Flow 'volume_create_manager' (25705ad3-4ded-430c-b7cd-878e7a0c033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56ae5f-5d78-4a3d-98b2-210529e80fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56ae5f-5d78-4a3d-98b2-210529e80fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2073015265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c7638-6226-4cce-a9b0-c9b2b291c1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e040011634bcf9df5a935091b975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:45Z,use_quota=True,user_id='d3d5ea68d84245f5af035e1cd0325d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678c317d-c41a-4126-8d2e-879b3ab1013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678c317d-c41a-4126-8d2e-879b3ab1013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e8f3c8-534f-4762-9a30-70c7bcf291cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:44 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e8f3c8-534f-4762-9a30-70c7bcf291cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'volume_name': 'volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d5ac2-35b5-4f41-8d69-0729f7329aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d5ac2-35b5-4f41-8d69-0729f7329aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a140bb-fc7f-47d3-8e36-907bcd3708b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Trying to clone 445c7638-6226-4cce-a9b0-c9b2b291c1b7 from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:44:45 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Image download 20.69 MB at 20.69 MB/s Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f670448-7f51-421c-bf60-bb471b864aa0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:46 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD Aug 20 06:44:46 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:46 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 is fetched for user d3d5ea68d84245f5af035e1cd0325d02. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2668a-07d0-40fa-bf48-efa0fda44b97]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:46 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD Aug 20 06:44:46 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:46 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2073015265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c7638-6226-4cce-a9b0-c9b2b291c1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e040011634bcf9df5a935091b975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:45Z,use_quota=True,user_id='d3d5ea68d84245f5af035e1cd0325d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Creating volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:46 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:47 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1073741824 Aug 20 06:44:47 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:47 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1073741824" returned: 0 in 0.557s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:47 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 Aug 20 06:44:47 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:47 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7" returned: 0 in 0.336s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:47 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Attempting download of d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c89605-0c61-44b8-b77a-7aab2a7c6644]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:48 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w Aug 20 06:44:48 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (555873e2-6a4e-4af1-8c9d-644cae129c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7602e51b-8153-46cd-bf12-8a8028243f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7602e51b-8153-46cd-bf12-8a8028243f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1064044961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44cdb23-d86b-4ac2-b8a2-300a58457db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:48Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff9fb6b-259f-4b72-8a50-25073eb0613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff9fb6b-259f-4b72-8a50-25073eb0613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8899289f-38a7-45b1-8db9-e0ebe51099b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8899289f-38a7-45b1-8db9-e0ebe51099b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44cdb23-d86b-4ac2-b8a2-300a58457db3', 'volume_name': 'volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4548c87-c255-4cd3-b1b6-be08f354f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4548c87-c255-4cd3-b1b6-be08f354f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3a389-6140-453b-8a15-a61a0f33565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Volume a44cdb23-d86b-4ac2-b8a2-300a58457db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3', 'volume_size': 1} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1064044961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44cdb23-d86b-4ac2-b8a2-300a58457db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:48Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Creating volume a44cdb23-d86b-4ac2-b8a2-300a58457db3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:48 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:48 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 1073741824 Aug 20 06:44:48 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:48 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w" returned: 0 in 0.427s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:48 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w Aug 20 06:44:48 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:48 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w" returned: 1 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_wo_4z45w' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8e0851-8fb9-48d9-8977-d1d0aa76a24d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:49 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 1073741824" returned: 0 in 0.645s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:49 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 Aug 20 06:44:49 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:49 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD Aug 20 06:44:49 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:49 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3" returned: 0 in 0.314s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3a389-6140-453b-8a15-a61a0f33565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:49 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b87988f-c152-40d2-8640-882f526be99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:49 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Volume volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 (a44cdb23-d86b-4ac2-b8a2-300a58457db3): created successfully Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b87988f-c152-40d2-8640-882f526be99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:49 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 Aug 20 06:44:49 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (555873e2-6a4e-4af1-8c9d-644cae129c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-505bc709-3ed8-4c4c-b022-8dc5d2efa394 tempest-VolumesListAdminTestJSON-1713474941 None] Created volume successfully. Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (a53a2a33-835e-42fe-8ac1-50766b971ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84fd54-eb41-4702-bc9e-46c6e1921cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84fd54-eb41-4702-bc9e-46c6e1921cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1444834734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81f19a4-12cc-43a9-a4d6-473877b8654d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:51Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384aac0a-0585-482f-944a-0074c05a27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384aac0a-0585-482f-944a-0074c05a27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab54117-c5c6-4c3d-945a-a37ef51c3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab54117-c5c6-4c3d-945a-a37ef51c3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81f19a4-12cc-43a9-a4d6-473877b8654d', 'volume_name': 'volume-e81f19a4-12cc-43a9-a4d6-473877b8654d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0182d9-b0fd-425b-babb-faae5ec4e8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0182d9-b0fd-425b-babb-faae5ec4e8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10c3871-2fd8-497f-8e9c-05f6ee3dac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Volume e81f19a4-12cc-43a9-a4d6-473877b8654d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81f19a4-12cc-43a9-a4d6-473877b8654d', 'volume_size': 1} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1444834734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81f19a4-12cc-43a9-a4d6-473877b8654d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:51Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Creating volume e81f19a4-12cc-43a9-a4d6-473877b8654d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:51 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:51 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d 1073741824 Aug 20 06:44:51 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Flow 'volume_create_manager' (4d36534b-962a-47e0-a15e-797864559d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e188bc5e-e211-4199-a06b-7a7846b8adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e188bc5e-e211-4199-a06b-7a7846b8adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765741446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7012169-7d42-47db-a2dd-2852812b3dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05414a9fb8e14db18e150fb74ef09596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:51Z,use_quota=True,user_id='8804b04628f84d49bc74d230c08ab1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09401921-716f-4242-80bb-96a2161be0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09401921-716f-4242-80bb-96a2161be0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7989070-561e-46c5-9da3-3aa742ccf22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7989070-561e-46c5-9da3-3aa742ccf22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7012169-7d42-47db-a2dd-2852812b3dee', 'volume_name': 'volume-e7012169-7d42-47db-a2dd-2852812b3dee', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8ac88a-0057-4013-8f82-c55f18f7b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8ac88a-0057-4013-8f82-c55f18f7b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce4421f-55a7-4af7-aad8-4a2120804e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Volume e7012169-7d42-47db-a2dd-2852812b3dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7012169-7d42-47db-a2dd-2852812b3dee', 'volume_size': 1} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (d07b9ede-408c-421c-962c-45f4470ec2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101f49a6-8c71-4516-8c3c-d3cd74795dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101f49a6-8c71-4516-8c3c-d3cd74795dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-478251911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f20be74781f4a479a9cbd385d6480da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:52Z,use_quota=True,user_id='23a1abff71e44d3cbab2138a80db6b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0fddb5-e4ef-42c8-9b46-3092291be78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0fddb5-e4ef-42c8-9b46-3092291be78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b22fff9-42c1-406d-b7e1-746466df1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b22fff9-42c1-406d-b7e1-746466df1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd', 'volume_name': 'volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbab2c0-5c5d-4973-aabd-a1fea9e20094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbab2c0-5c5d-4973-aabd-a1fea9e20094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47a751-587f-42fc-91de-30481cdbd040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd', 'volume_size': 1} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:51 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7" returned: 0 in 2.385s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_oxxey5g4devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:44:51 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Converted 112.00 MB image at 46.95 MB/s Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:51 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1G Aug 20 06:44:51 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:51 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d 1073741824" returned: 0 in 0.648s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:51 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d Aug 20 06:44:51 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:52 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 1G" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Downloaded image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:44:52 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 for user d3d5ea68d84245f5af035e1cd0325d02 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Marking volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765741446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7012169-7d42-47db-a2dd-2852812b3dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05414a9fb8e14db18e150fb74ef09596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:51Z,use_quota=True,user_id='8804b04628f84d49bc74d230c08ab1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Creating volume e7012169-7d42-47db-a2dd-2852812b3dee {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:52 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10c3871-2fd8-497f-8e9c-05f6ee3dac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81f19a4-12cc-43a9-a4d6-473877b8654d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:52 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee 1073741824 Aug 20 06:44:52 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a46a9d-af5a-443b-86cc-f0cf030fe119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Copying metadata from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 to 445c7638-6226-4cce-a9b0-c9b2b291c1b7. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Creating volume glance metadata for volume 445c7638-6226-4cce-a9b0-c9b2b291c1b7 backed by image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:44:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Volume volume-e81f19a4-12cc-43a9-a4d6-473877b8654d (e81f19a4-12cc-43a9-a4d6-473877b8654d): created successfully Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a46a9d-af5a-443b-86cc-f0cf030fe119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (a53a2a33-835e-42fe-8ac1-50766b971ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0efdf25c-e5ee-4651-9e02-8d776d5f3903 tempest-VolumesListAdminTestJSON-1713474941 None] Created volume successfully. Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a140bb-fc7f-47d3-8e36-907bcd3708b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a91dad-8ffc-4f36-816f-b35a485a4baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Volume volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 (445c7638-6226-4cce-a9b0-c9b2b291c1b7): created successfully Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a91dad-8ffc-4f36-816f-b35a485a4baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Flow 'volume_create_manager' (25705ad3-4ded-430c-b7cd-878e7a0c033a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c0fde878-0109-4478-8f36-c8eefed585ea tempest-TestShelveInstance-1544697348 None] Created volume successfully. Aug 20 06:44:52 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee 1073741824" returned: 0 in 0.531s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:52 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee Aug 20 06:44:52 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:53 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-478251911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f20be74781f4a479a9cbd385d6480da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:52Z,use_quota=True,user_id='23a1abff71e44d3cbab2138a80db6b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Creating volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:53 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:53 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd 1073741824 Aug 20 06:44:53 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (486b4e4c-9ed2-49a6-ad3d-25fc91c69f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0a585a-bef2-42ce-ab18-4f71ea0ddd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce4421f-55a7-4af7-aad8-4a2120804e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7012169-7d42-47db-a2dd-2852812b3dee', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639dc2cf-d7ee-4061-9e7c-64988e26da76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0a585a-bef2-42ce-ab18-4f71ea0ddd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1471020220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9e75ea-5d9e-4376-b03f-796f8e2847d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:53Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5447afc-744a-4c62-8abf-bc5891aca449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5447afc-744a-4c62-8abf-bc5891aca449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca827020-b749-416b-84b6-359065ff94f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca827020-b749-416b-84b6-359065ff94f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9e75ea-5d9e-4376-b03f-796f8e2847d3', 'volume_name': 'volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbe711c-cb2a-4b91-a60e-2413bf8d9481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbe711c-cb2a-4b91-a60e-2413bf8d9481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36795f-3845-41ea-a758-3d138620c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Volume 1a9e75ea-5d9e-4376-b03f-796f8e2847d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3', 'volume_size': 1} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Volume volume-e7012169-7d42-47db-a2dd-2852812b3dee (e7012169-7d42-47db-a2dd-2852812b3dee): created successfully Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639dc2cf-d7ee-4061-9e7c-64988e26da76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Flow 'volume_create_manager' (4d36534b-962a-47e0-a15e-797864559d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-255871ae-8839-4015-81e2-e063a16177f5 tempest-VolumesTransfersTest-244716006 None] Created volume successfully. Aug 20 06:44:53 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd 1073741824" returned: 0 in 0.500s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:53 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:44:53 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:53 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1471020220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9e75ea-5d9e-4376-b03f-796f8e2847d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36574af0ae2d49a4a4302b7df3a2f523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:53Z,use_quota=True,user_id='2c38fd01ad7b4316855e289fbfbe0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Creating volume 1a9e75ea-5d9e-4376-b03f-796f8e2847d3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:53 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47a751-587f-42fc-91de-30481cdbd040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:54 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 1073741824 Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaf8b60-e3fd-44d3-ba22-2c27517fd549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:54 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Volume volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd (0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd): created successfully Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaf8b60-e3fd-44d3-ba22-2c27517fd549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (d07b9ede-408c-421c-962c-45f4470ec2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a76e2990-4abf-49a8-91c2-2237354966f5 tempest-VolumesDeleteCascade-1975823073 None] Created volume successfully. Aug 20 06:44:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e82833a4-f1a1-42d7-ad8c-5cea19553533 tempest-VolumesTransfersTest-1152560182 None] Transfer volume completed successfully. Aug 20 06:44:54 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 1073741824" returned: 0 in 0.614s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:54 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 Aug 20 06:44:54 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:54 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" returned: 0 in 0.313s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36795f-3845-41ea-a758-3d138620c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f024acb-c0b6-4a36-b72a-1c8f357188c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Volume volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 (1a9e75ea-5d9e-4376-b03f-796f8e2847d3): created successfully Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f024acb-c0b6-4a36-b72a-1c8f357188c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Flow 'volume_create_manager' (486b4e4c-9ed2-49a6-ad3d-25fc91c69f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "cinder-e7012169-7d42-47db-a2dd-2852812b3dee-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-badbadb7-8f89-43b1-9cb7-6e166c95c466 tempest-VolumesListAdminTestJSON-1713474941 None] Created volume successfully. Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-e7012169-7d42-47db-a2dd-2852812b3dee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "cinder-quobyte-e7012169-7d42-47db-a2dd-2852812b3dee" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-quobyte-e7012169-7d42-47db-a2dd-2852812b3dee" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56dc295-4cc0-4387-b678-88b0b24d5587]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:55 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee Aug 20 06:44:55 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Creating offline snapshot 752111fd-663a-4f1f-9562-5cea1bde030c of volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0752c3-371f-4849-9134-7e9fc4a8f657]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:55 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:44:55 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:55 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee" returned: 0 in 0.656s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:55 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee Aug 20 06:44:55 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:56 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.630s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-1a82685b-865e-4d52-a8db-a16617d948b5 req-fedc5929-e04f-4fd4-b45c-5c9633585e9a tempest-TestShelveInstance-1544697348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:56 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c 1G Aug 20 06:44:56 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:56 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7012169-7d42-47db-a2dd-2852812b3dee" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-quobyte-e7012169-7d42-47db-a2dd-2852812b3dee" released by "delete_volume" :: held 1.188s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Flow 'volume_create_manager' (d80a785c-0ab1-46d3-b1ce-6d515c1edd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c675c38c-cee9-4f0e-889d-00a2d63ab8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c675c38c-cee9-4f0e-889d-00a2d63ab8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e652056-58ce-4e0e-9bd5-5501bbb80da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cb8a4f977f4dbdabdf32e45aa8f1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:56Z,use_quota=True,user_id='70afa7a978bc46c89816e2c64a8459d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b52b558-0d07-4f0a-b4fc-141d6863a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b52b558-0d07-4f0a-b4fc-141d6863a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff5d80-0692-4c25-8c3c-4621eb8bae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff5d80-0692-4c25-8c3c-4621eb8bae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e652056-58ce-4e0e-9bd5-5501bbb80da3', 'volume_name': 'volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b4c39-3144-4de3-9de9-9f73ec80793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b4c39-3144-4de3-9de9-9f73ec80793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8643bd50-49c7-4c0a-abae-af2880f5f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:56 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Volume 8e652056-58ce-4e0e-9bd5-5501bbb80da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3', 'volume_size': 1} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Created reservations ['08c332e0-3505-4dff-82c5-2a500f46dd54', 'b53e1177-88ff-480b-8f5e-b3b4d0c5dc74', '76235cfd-095d-4ebb-bd23-31318c5c3d3e', '472656f6-4a63-42bb-a27a-a86c941af23e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:56 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:44:56 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:56 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c 1G" returned: 0 in 0.615s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:56 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:44:56 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:56 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:56 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:44:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Deleted volume successfully. Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7e42eccf-f89d-45b8-a87f-23027cf5331d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-e7012169-7d42-47db-a2dd-2852812b3dee-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:44:57 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:57 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c is being set with open permissions: ugo+rw Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:57 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:44:57 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:57 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.275s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:57 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info Aug 20 06:44:57 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:57 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:57 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info is being set with open permissions: ugo+rw Aug 20 06:44:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:57 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info Aug 20 06:44:57 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Flow 'volume_create_manager' (28afdb27-118a-4773-a3ec-f956a3eddd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f3602-33e7-4281-857f-54b7176354f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f3602-33e7-4281-857f-54b7176354f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1554787596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186244c2-7ae5-4b19-a900-5db73525b820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05414a9fb8e14db18e150fb74ef09596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:58Z,use_quota=True,user_id='8804b04628f84d49bc74d230c08ab1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81447f2b-fa3e-43db-b0e3-94b13c1085ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81447f2b-fa3e-43db-b0e3-94b13c1085ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecc0731-83e8-43cf-9c60-c21f43889b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecc0731-83e8-43cf-9c60-c21f43889b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186244c2-7ae5-4b19-a900-5db73525b820', 'volume_name': 'volume-186244c2-7ae5-4b19-a900-5db73525b820', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf65a727-608f-48d1-8e77-2c2128ae12cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf65a727-608f-48d1-8e77-2c2128ae12cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4eeb9e-cdc6-4ec1-849f-18c13a50230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:58 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Volume 186244c2-7ae5-4b19-a900-5db73525b820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186244c2-7ae5-4b19-a900-5db73525b820', 'volume_size': 1} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:58 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.info" returned: 0 in 0.335s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-1a82685b-865e-4d52-a8db-a16617d948b5 req-fedc5929-e04f-4fd4-b45c-5c9633585e9a tempest-TestShelveInstance-1544697348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.997s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-1a82685b-865e-4d52-a8db-a16617d948b5 req-fedc5929-e04f-4fd4-b45c-5c9633585e9a tempest-TestShelveInstance-1544697348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e652056-58ce-4e0e-9bd5-5501bbb80da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cb8a4f977f4dbdabdf32e45aa8f1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:56Z,use_quota=True,user_id='70afa7a978bc46c89816e2c64a8459d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Creating volume 8e652056-58ce-4e0e-9bd5-5501bbb80da3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:58 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e227d98a-fe2b-4e29-b6a7-d68e4accbf18 tempest-VolumesDeleteCascade-1975823073 None] Create snapshot completed successfully Aug 20 06:44:58 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 1073741824 Aug 20 06:44:58 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-1a82685b-865e-4d52-a8db-a16617d948b5 req-fedc5929-e04f-4fd4-b45c-5c9633585e9a tempest-TestShelveInstance-1544697348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78e85342-2fbd-420b-b88f-08f30a66cff6', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:44:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-1a82685b-865e-4d52-a8db-a16617d948b5 req-fedc5929-e04f-4fd4-b45c-5c9633585e9a tempest-TestShelveInstance-1544697348 None] attachment_update completed successfully. Aug 20 06:44:58 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 1073741824" returned: 0 in 0.548s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:58 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 Aug 20 06:44:58 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:59 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3" returned: 0 in 0.347s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1554787596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186244c2-7ae5-4b19-a900-5db73525b820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05414a9fb8e14db18e150fb74ef09596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:44:58Z,use_quota=True,user_id='8804b04628f84d49bc74d230c08ab1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Creating volume 186244c2-7ae5-4b19-a900-5db73525b820 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:44:59 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8643bd50-49c7-4c0a-abae-af2880f5f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337592bf-9ccd-443a-94ac-e8cda6fd361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:44:59 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 1073741824 Aug 20 06:44:59 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:44:59 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Volume volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 (8e652056-58ce-4e0e-9bd5-5501bbb80da3): created successfully Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337592bf-9ccd-443a-94ac-e8cda6fd361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Flow 'volume_create_manager' (d80a785c-0ab1-46d3-b1ce-6d515c1edd67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:44:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cc796d36-d347-40d8-a015-5046731c5e23 tempest-VolumesListAdminTestJSON-1756048908 None] Created volume successfully. Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Acquiring lock "cinder-8e652056-58ce-4e0e-9bd5-5501bbb80da3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "cinder-8e652056-58ce-4e0e-9bd5-5501bbb80da3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Acquiring lock "cinder-quobyte-8e652056-58ce-4e0e-9bd5-5501bbb80da3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "cinder-quobyte-8e652056-58ce-4e0e-9bd5-5501bbb80da3" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[72261f6e-7c1c-44fa-9dcb-a3dec5653165]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:44:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-1a9e75ea-5d9e-4376-b03f-796f8e2847d3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-1a9e75ea-5d9e-4376-b03f-796f8e2847d3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-quobyte-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:00 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 Aug 20 06:45:00 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579a0d1-0d5d-49cf-a639-912ff8d47374]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:00 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 1073741824" returned: 0 in 1.123s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:00 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 Aug 20 06:45:00 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:00 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 Aug 20 06:45:00 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:00 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3" returned: 0 in 0.679s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:00 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3 Aug 20 06:45:00 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:00 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.557s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4eeb9e-cdc6-4ec1-849f-18c13a50230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186244c2-7ae5-4b19-a900-5db73525b820', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e86ff77-efff-4b9e-b93d-3b62fe1ab215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Creating offline snapshot 7ac408e4-063d-4622-8fb9-a108dd319cec of volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:45:00 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Volume volume-186244c2-7ae5-4b19-a900-5db73525b820 (186244c2-7ae5-4b19-a900-5db73525b820): created successfully Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e86ff77-efff-4b9e-b93d-3b62fe1ab215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Flow 'volume_create_manager' (28afdb27-118a-4773-a3ec-f956a3eddd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb8149-fdfa-4c02-91ff-165f1968544c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:01 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-02cb0bd7-8d63-4054-a12a-cb2fd9363479 tempest-VolumesTransfersTest-244716006 None] Created volume successfully. Aug 20 06:45:01 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" returned: 0 in 0.744s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8e652056-58ce-4e0e-9bd5-5501bbb80da3" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:01 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3 Aug 20 06:45:01 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "cinder-quobyte-8e652056-58ce-4e0e-9bd5-5501bbb80da3" released by "delete_volume" :: held 1.198s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Created reservations ['def529ce-8c68-4575-badc-28a904c6d9f5', 'aa1a8966-85ec-45ae-9b91-88ee31477651', '698c141b-4669-4383-aedc-245086f30a80', '8cf3d0f3-e17c-4129-a545-1a052e9c112a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:01 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:45:01 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:01 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:01 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:01 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" returned: 0 in 0.409s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-1a9e75ea-5d9e-4376-b03f-796f8e2847d3" released by "delete_volume" :: held 1.267s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:01 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.552s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:01 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec 1G Aug 20 06:45:01 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Created reservations ['22ea03fe-8433-427a-b88a-6a30b6916935', '24b9129d-52e5-4549-8c1f-a494276e3770', 'c04b5086-02b2-4300-aeaf-338fb2c39924', '5f38d738-ca6e-4a16-9c48-8f17a0f390a1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:01 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.458s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Deleted volume successfully. Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-13a519cb-2006-419d-917a-68a80e2f01f5 tempest-VolumesListAdminTestJSON-1756048908 None] Lock "cinder-8e652056-58ce-4e0e-9bd5-5501bbb80da3-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:01 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:01 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "cinder-186244c2-7ae5-4b19-a900-5db73525b820-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-186244c2-7ae5-4b19-a900-5db73525b820-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "cinder-quobyte-186244c2-7ae5-4b19-a900-5db73525b820" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-quobyte-186244c2-7ae5-4b19-a900-5db73525b820" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c302bd37-65c4-4c7f-a1aa-fe430b9595b1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:02 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.366s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Deleted volume successfully. Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-879765c7-35b3-437c-9a97-9a2f880d2743 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-1a9e75ea-5d9e-4376-b03f-796f8e2847d3-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:02 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 Aug 20 06:45:02 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:02 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec 1G" returned: 0 in 0.787s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:02 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:02 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-e81f19a4-12cc-43a9-a4d6-473877b8654d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-e81f19a4-12cc-43a9-a4d6-473877b8654d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:02 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820" returned: 0 in 0.542s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-quobyte-e81f19a4-12cc-43a9-a4d6-473877b8654d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:02 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820 Aug 20 06:45:02 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-e81f19a4-12cc-43a9-a4d6-473877b8654d" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12e54f6-81aa-43d8-b23d-7c92ed90c025]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:02 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.459s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:02 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec is being set with open permissions: ugo+rw Aug 20 06:45:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:02 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:02 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:02 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d Aug 20 06:45:02 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:03 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-186244c2-7ae5-4b19-a900-5db73525b820" returned: 0 in 0.467s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-quobyte-186244c2-7ae5-4b19-a900-5db73525b820" released by "delete_volume" :: held 1.092s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Created reservations ['dc50d407-1c50-4571-9b8b-c08c0e315b73', 'a199fe89-6e1e-454d-93a1-6a3d7ea58040', '21c23736-3d5d-47ae-b19f-9211bbca9c5d', '4473e07d-1402-4a28-af68-a9d914cf1ad5'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:03 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:03 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d" returned: 0 in 0.639s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.588s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:03 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d Aug 20 06:45:03 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fc7f2b6d-2f29-476a-acb7-e5d0e01ba5d4 tempest-VolumesDeleteCascade-1975823073 None] Create snapshot completed successfully Aug 20 06:45:03 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:03 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:03 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e81f19a4-12cc-43a9-a4d6-473877b8654d" returned: 0 in 0.406s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-e81f19a4-12cc-43a9-a4d6-473877b8654d" released by "delete_volume" :: held 1.099s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Created reservations ['6d251bda-311d-4c19-bc1f-fdcdecfbdae4', '5a97ccb6-eb06-420e-9831-7938b5c23150', 'f7a0e88f-06b5-4b28-9b6b-6a608dfa4292', '6b7c5eb0-872b-4620-8bbf-1a1c66dc26aa'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:03 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.452s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:03 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Deleted volume successfully. Aug 20 06:45:03 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:04 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f94d108f-4911-409b-93a2-0ddbab4f819d tempest-VolumesTransfersTest-1646448490 None] Lock "cinder-186244c2-7ae5-4b19-a900-5db73525b820-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:04 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Deleted volume successfully. Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a6bf626c-697f-41e7-bf2e-949df8d9466f tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-e81f19a4-12cc-43a9-a4d6-473877b8654d-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Performing cascade delete. {{(pid=94234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-752111fd-663a-4f1f-9562-5cea1bde030c-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-752111fd-663a-4f1f-9562-5cea1bde030c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-752111fd-663a-4f1f-9562-5cea1bde030c" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-752111fd-663a-4f1f-9562-5cea1bde030c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Deleting offline snapshot 752111fd-663a-4f1f-9562-5cea1bde030c of volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] snapshot_file for this snap is: volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd801708-38b4-4e95-b870-b069f23b2a1f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-a44cdb23-d86b-4ac2-b8a2-300a58457db3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-a44cdb23-d86b-4ac2-b8a2-300a58457db3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "cinder-quobyte-a44cdb23-d86b-4ac2-b8a2-300a58457db3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-a44cdb23-d86b-4ac2-b8a2-300a58457db3" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d0b887-ccab-4518-9c63-8550e2efb16d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:05 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:45:05 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:05 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 Aug 20 06:45:05 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:05 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.725s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4350e04e-8f04-435b-b416-129453955e5b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:06 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:45:06 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:06 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3" returned: 0 in 0.816s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:06 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3 Aug 20 06:45:06 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:06 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a44cdb23-d86b-4ac2-b8a2-300a58457db3" returned: 0 in 0.485s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-quobyte-a44cdb23-d86b-4ac2-b8a2-300a58457db3" released by "delete_volume" :: held 1.425s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:06 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.813s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c7f56-9f7f-4bbc-a443-14ad73f06dc5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Created reservations ['aa3644d7-40a0-40d9-821a-b7ced591d153', '697c2630-e243-4340-a704-9570640d825d', '7a47ddff-e679-4f71-a336-b56fdb63d7ec', '4e9ee92d-4643-4ff6-b426-c7ce36e49101'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:07 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:07 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:07 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:07 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:07 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.426s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Deleted volume successfully. Aug 20 06:45:07 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-863d12f5-2137-4ea7-8dbe-2f105327dcb8 tempest-VolumesListAdminTestJSON-1713474941 None] Lock "cinder-a44cdb23-d86b-4ac2-b8a2-300a58457db3-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.788s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb4730-a862-4fe2-b73e-91395fdfbf24]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:07 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:45:07 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:08 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.641s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba1bf4-41c5-4f3c-a95f-9d3581bb09b6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:08 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:45:08 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:08 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.697s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:09 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:45:09 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:09 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.542s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:09 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c Aug 20 06:45:09 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:09 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.752111fd-663a-4f1f-9562-5cea1bde030c" returned: 0 in 0.342s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec -F qcow2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:09 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec -F qcow2 Aug 20 06:45:09 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:10 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec -F qcow2" returned: 0 in 0.503s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-752111fd-663a-4f1f-9562-5cea1bde030c" released by "_delete_snapshot" :: held 5.381s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" released by "delete_snapshot" :: held 5.419s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['15f6dd84-e2e0-4a51-9bc6-f905042bdccf', '57a9201f-7934-4b19-90a2-9e713a1c5de4', '4989a030-3f06-4458-b0fe-50060bf8cb98', '346f1184-939d-4ea0-a036-b3f9b964a615'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Delete snapshot completed successfully. Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-752111fd-663a-4f1f-9562-5cea1bde030c-delete_snapshot" released by "delete_snapshot" :: held 5.740s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-7ac408e4-063d-4622-8fb9-a108dd319cec-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-7ac408e4-063d-4622-8fb9-a108dd319cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-7ac408e4-063d-4622-8fb9-a108dd319cec" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-7ac408e4-063d-4622-8fb9-a108dd319cec" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Deleting offline snapshot 7ac408e4-063d-4622-8fb9-a108dd319cec of volume 0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] snapshot_file for this snap is: volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f4c709-a48b-4e86-89fc-df2ad11db0cd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:10 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:11 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:11 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.553s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd2f19-0b0b-431f-8fc3-b4ae9a89666f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:11 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:45:11 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:11 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.544s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:12 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:12 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:12 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.393s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:12 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec Aug 20 06:45:12 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:12 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd.7ac408e4-063d-4622-8fb9-a108dd319cec" returned: 0 in 0.304s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-7ac408e4-063d-4622-8fb9-a108dd319cec" released by "_delete_snapshot" :: held 1.936s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" released by "delete_snapshot" :: held 1.983s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=147,cinder:UPDATE=150,cinder:INSERT=50,cinder:DELETE=17 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=174,cinder:SELECT=122,cinder:INSERT=51,cinder:DELETE=12 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['1b25c938-e9f8-4d3a-9bb9-587c31144267', 'c936330d-de87-4af7-8271-c45b3f36d727', '55c5bfb3-8e2e-4d39-9337-14b557164343', '43c2e1ff-b657-427d-953e-22169cd66e3e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Delete snapshot completed successfully. Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-7ac408e4-063d-4622-8fb9-a108dd319cec-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Snapshots deleted, issuing volume delete {{(pid=94234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e051c4-cc34-40e4-ad96-df4ec369fa3b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:13 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:45:13 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:13 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.499s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:13 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd Aug 20 06:45:13 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:13 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" returned: 0 in 0.404s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd" released by "delete_volume" :: held 1.003s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['24e085ec-6281-4831-bd7e-3b8fd70c54c6', 'f41f3fa1-109d-4479-aaa1-619a09e5c844', '2888ed56-9b03-413f-b146-b15a1b1163f9', '70e43cdd-2c91-4362-a16a-ce96b54f1906'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:14 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:14 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Flow 'volume_create_manager' (0427d39c-6936-4e25-be96-1efb95ddb328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615b42d-2d63-4984-a925-82aa3254221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615b42d-2d63-4984-a925-82aa3254221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-861949176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fbdbf3-e079-444b-b8fa-e7c0ba430622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84863390d6824bd08154d4349081023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:14Z,use_quota=True,user_id='05d777427e9943839380d51653eab000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bb8e5c-7ba3-430c-b58e-cf09b126259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bb8e5c-7ba3-430c-b58e-cf09b126259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff49979-3fd8-4b73-85b0-7260725ad539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff49979-3fd8-4b73-85b0-7260725ad539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fbdbf3-e079-444b-b8fa-e7c0ba430622', 'volume_name': 'volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c8988-1908-4000-b6ac-aae8d93847f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c8988-1908-4000-b6ac-aae8d93847f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1dcdb1-5422-4eff-920e-de81c12a34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Volume f8fbdbf3-e079-444b-b8fa-e7c0ba430622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622', 'volume_size': 1} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-861949176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fbdbf3-e079-444b-b8fa-e7c0ba430622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84863390d6824bd08154d4349081023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:14Z,use_quota=True,user_id='05d777427e9943839380d51653eab000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Creating volume f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:14 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:14 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 1073741824 Aug 20 06:45:14 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:14 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Deleted volume successfully. Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5d74a57e-1bf8-4820-a880-9c6bffebc48a tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-0b01bbb4-423e-40cf-98d6-2ef9eb3a1edd-delete_volume" released by "delete_volume" :: held 9.721s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:14 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 1073741824" returned: 0 in 0.544s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:14 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 Aug 20 06:45:14 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:15 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" returned: 0 in 0.429s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1dcdb1-5422-4eff-920e-de81c12a34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb654a4-c404-4485-b6c5-7a8897de8ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Volume volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 (f8fbdbf3-e079-444b-b8fa-e7c0ba430622): created successfully Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb654a4-c404-4485-b6c5-7a8897de8ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Flow 'volume_create_manager' (0427d39c-6936-4e25-be96-1efb95ddb328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fdd2c9c2-b1bc-4432-9af6-de6b131f1dde tempest-SnapshotMetadataTestJSON-1320551542 None] Created volume successfully. Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (1e230c16-81b6-4ff1-a580-8a1043fc6c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f1e60d-369c-40de-8f7c-ad977c4518a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f1e60d-369c-40de-8f7c-ad977c4518a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1532660894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14598ee4-f915-4865-b596-f81f2631ad08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f20be74781f4a479a9cbd385d6480da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:16Z,use_quota=True,user_id='23a1abff71e44d3cbab2138a80db6b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ac2c11-5c36-4461-8a23-7f34c9494777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ac2c11-5c36-4461-8a23-7f34c9494777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5fa5c-e0f7-4fcd-bbd6-85cd021efce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5fa5c-e0f7-4fcd-bbd6-85cd021efce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14598ee4-f915-4865-b596-f81f2631ad08', 'volume_name': 'volume-14598ee4-f915-4865-b596-f81f2631ad08', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da44e7b-18f2-4d2d-aec5-a77da89400b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da44e7b-18f2-4d2d-aec5-a77da89400b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0663a787-2a33-4719-bafa-6bd6a127067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:15 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Volume 14598ee4-f915-4865-b596-f81f2631ad08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14598ee4-f915-4865-b596-f81f2631ad08', 'volume_size': 1} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1532660894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14598ee4-f915-4865-b596-f81f2631ad08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f20be74781f4a479a9cbd385d6480da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:16Z,use_quota=True,user_id='23a1abff71e44d3cbab2138a80db6b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Creating volume 14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:16 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:16 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 1073741824 Aug 20 06:45:16 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:16 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 1073741824" returned: 0 in 0.612s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:16 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:16 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:16 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.306s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.432s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0663a787-2a33-4719-bafa-6bd6a127067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14598ee4-f915-4865-b596-f81f2631ad08', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8f37d3-d798-4457-8dee-c5fb649975de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Creating offline snapshot 6943bdb2-7ccd-45f4-ac08-ade89963b7fa of volume f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:45:17 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Volume volume-14598ee4-f915-4865-b596-f81f2631ad08 (14598ee4-f915-4865-b596-f81f2631ad08): created successfully Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8f37d3-d798-4457-8dee-c5fb649975de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (1e230c16-81b6-4ff1-a580-8a1043fc6c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0cda0-7b70-459b-b9b0-b53a3a0e551c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9b377798-8a89-411c-a475-48cd8d6cf68e tempest-VolumesDeleteCascade-1975823073 None] Created volume successfully. Aug 20 06:45:17 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 Aug 20 06:45:17 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Flow 'volume_create_manager' (8fb40cc2-6962-4ba0-a163-ac86b7a97d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945f15a6-34e1-48a7-b469-d65b2b9d5629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945f15a6-34e1-48a7-b469-d65b2b9d5629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1831219794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaef275-207c-4a91-8d19-473c029da5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fdf0c3cf40491c9c5bdf01f8fdca94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:17Z,use_quota=True,user_id='c12cf406f83f4282b83f75dac1316f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30acb39d-2f6d-40d6-aea6-5632a1b74938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30acb39d-2f6d-40d6-aea6-5632a1b74938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f838a97-6637-4ca8-84ee-f0346bc95a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f838a97-6637-4ca8-84ee-f0346bc95a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaef275-207c-4a91-8d19-473c029da5e4', 'volume_name': 'volume-acaef275-207c-4a91-8d19-473c029da5e4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fe1863-8821-4339-9a92-c0caea47710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fe1863-8821-4339-9a92-c0caea47710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e38bd9f-cd0c-4556-b8a8-b7b89cb3c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:17 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Volume acaef275-207c-4a91-8d19-473c029da5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaef275-207c-4a91-8d19-473c029da5e4', 'volume_size': 1} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:17 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" returned: 0 in 0.420s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:17 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa 1G Aug 20 06:45:17 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:17 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa 1G" returned: 0 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:17 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa Aug 20 06:45:17 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:18 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa is being set with open permissions: ugo+rw Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:18 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa Aug 20 06:45:18 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:18 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa" returned: 0 in 0.251s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:18 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info Aug 20 06:45:18 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:18 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info" returned: 0 in 0.298s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info is being set with open permissions: ugo+rw Aug 20 06:45:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:18 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info Aug 20 06:45:18 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:19 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.info" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1831219794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaef275-207c-4a91-8d19-473c029da5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fdf0c3cf40491c9c5bdf01f8fdca94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:17Z,use_quota=True,user_id='c12cf406f83f4282b83f75dac1316f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Creating volume acaef275-207c-4a91-8d19-473c029da5e4 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:19 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:19 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 1073741824 Aug 20 06:45:19 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3a3aa265-df83-4d32-9880-b8659c7729d6 tempest-SnapshotMetadataTestJSON-1320551542 None] Create snapshot completed successfully Aug 20 06:45:19 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 1073741824" returned: 0 in 0.521s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:19 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 Aug 20 06:45:19 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:20 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4" returned: 0 in 0.300s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.879s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e38bd9f-cd0c-4556-b8a8-b7b89cb3c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaef275-207c-4a91-8d19-473c029da5e4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d1fa93-b98a-425d-ad3d-d7aa9ceae86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Creating offline snapshot ce3daec7-7625-4011-a4e4-1a83a38a1ea4 of volume 14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:45:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Volume volume-acaef275-207c-4a91-8d19-473c029da5e4 (acaef275-207c-4a91-8d19-473c029da5e4): created successfully Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d1fa93-b98a-425d-ad3d-d7aa9ceae86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Flow 'volume_create_manager' (8fb40cc2-6962-4ba0-a163-ac86b7a97d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830c255-7d91-437a-8ca6-18078b16f45c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-797e2517-7c97-4246-bb86-7ed02b88745b tempest-VolumesNegativeTest-1026005541 None] Created volume successfully. Aug 20 06:45:20 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:20 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:20 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "cinder-6943bdb2-7ccd-45f4-ac08-ade89963b7fa-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.483s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:20 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 1G Aug 20 06:45:20 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-6943bdb2-7ccd-45f4-ac08-ade89963b7fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "cinder-quobyte-6943bdb2-7ccd-45f4-ac08-ade89963b7fa" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-6943bdb2-7ccd-45f4-ac08-ade89963b7fa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Deleting offline snapshot 6943bdb2-7ccd-45f4-ac08-ade89963b7fa of volume f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] snapshot_file for this snap is: volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c5a4a-c12e-4b50-ac4c-128d5ce8ccb3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:20 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa Aug 20 06:45:20 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:21 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 1G" returned: 0 in 0.496s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14598ee4-f915-4865-b596-f81f2631ad08 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:21 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14598ee4-f915-4865-b596-f81f2631ad08 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:21 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:21 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa" returned: 0 in 0.460s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403a0d0-1ab0-4657-b6ca-39e0d6d6b99e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:21 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 Aug 20 06:45:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:21 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14598ee4-f915-4865-b596-f81f2631ad08 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:21 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 is being set with open permissions: ugo+rw Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:21 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:21 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:21 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:21 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:21 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa Aug 20 06:45:21 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:21 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info Aug 20 06:45:21 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:22 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info" returned: 0 in 0.272s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:22 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info is being set with open permissions: ugo+rw Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:22 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info Aug 20 06:45:22 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa" returned: 0 in 0.443s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:22 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa Aug 20 06:45:22 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:22 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.info" returned: 0 in 0.290s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-abf9ae83-9e8b-41bb-bf1c-a5429db50e8c tempest-VolumesDeleteCascade-1975823073 None] Create snapshot completed successfully Aug 20 06:45:22 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622.6943bdb2-7ccd-45f4-ac08-ade89963b7fa" returned: 0 in 0.323s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-6943bdb2-7ccd-45f4-ac08-ade89963b7fa" released by "_delete_snapshot" :: held 1.816s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" released by "delete_snapshot" :: held 1.855s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Created reservations ['e0b632d9-e5bd-482c-9e33-bc60c6cbca0e', '252507ff-1aea-4171-b38b-dbda454fafb6', 'a0d71f48-4977-4c62-90d2-9b205df75443', 'a0a4b61d-c080-441c-b8b6-a31c40603090'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Delete snapshot completed successfully. Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-238fffd2-498d-4881-ad78-7d3dda85f732 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-6943bdb2-7ccd-45f4-ac08-ade89963b7fa-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "cinder-f8fbdbf3-e079-444b-b8fa-e7c0ba430622-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-f8fbdbf3-e079-444b-b8fa-e7c0ba430622-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[89119b1e-c117-496e-b92e-f7974e2eb570]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:23 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 Aug 20 06:45:23 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:23 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" returned: 0 in 0.527s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:23 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622 Aug 20 06:45:23 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:24 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" returned: 0 in 0.274s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-quobyte-f8fbdbf3-e079-444b-b8fa-e7c0ba430622" released by "delete_volume" :: held 0.878s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Created reservations ['5c2fc487-069c-4cc9-8b7a-9343945058e5', '0d620873-d609-4299-bdd3-bdc0c98d9745', '2fb855fd-d222-4d45-ae70-768c54c4b16e', '518701c2-348e-4747-aadd-16156c08113c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (52b45308-5492-47c6-8eb6-441677414239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e72241-56a0-418b-b161-731ce9333773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e72241-56a0-418b-b161-731ce9333773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-58857560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79574fd-8060-4e0e-94dc-926a804e7968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f20be74781f4a479a9cbd385d6480da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce3daec7-7625-4011-a4e4-1a83a38a1ea4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:24Z,use_quota=True,user_id='23a1abff71e44d3cbab2138a80db6b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bc07fe-c250-4c35-a430-c704a61d8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bc07fe-c250-4c35-a430-c704a61d8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5632313-5383-4e13-ad9a-3aa603d9888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5632313-5383-4e13-ad9a-3aa603d9888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e79574fd-8060-4e0e-94dc-926a804e7968', 'volume_name': 'volume-e79574fd-8060-4e0e-94dc-926a804e7968', 'volume_size': 1, 'snapshot_id': 'ce3daec7-7625-4011-a4e4-1a83a38a1ea4'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e838c56-a85c-44bc-8d02-f94f5b382acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e838c56-a85c-44bc-8d02-f94f5b382acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67d234e-321e-43a8-9f2e-1c88f2d010d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Volume e79574fd-8060-4e0e-94dc-926a804e7968: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e79574fd-8060-4e0e-94dc-926a804e7968', 'volume_size': 1, 'snapshot_id': 'ce3daec7-7625-4011-a4e4-1a83a38a1ea4'} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-e79574fd-8060-4e0e-94dc-926a804e7968" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-e79574fd-8060-4e0e-94dc-926a804e7968" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Creating volume e79574fd-8060-4e0e-94dc-926a804e7968 from snapshot ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] snapshot: ce3daec7-7625-4011-a4e4-1a83a38a1ea4, volume: e79574fd-8060-4e0e-94dc-926a804e7968, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:45:24 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:24 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a09d4-4ece-419c-ad64-c922ab84ff59]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:24 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:24 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:24 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Deleted volume successfully. Aug 20 06:45:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-46b04f5b-6fec-4a32-8590-4dfa80191658 tempest-SnapshotMetadataTestJSON-1320551542 None] Lock "cinder-f8fbdbf3-e079-444b-b8fa-e7c0ba430622-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:25 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.520s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14598ee4-f915-4865-b596-f81f2631ad08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb6311-dc95-4ad5-a4b8-0636548ce288]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:25 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:25 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:25 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.481s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:45:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:25 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 Aug 20 06:45:25 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Flow 'volume_create_manager' (cf296050-d297-484d-8ac5-58b8a4521f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649c250e-b008-4b5e-a3aa-1e928bea4c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:33 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649c250e-b008-4b5e-a3aa-1e928bea4c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1448585113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bdee52-50b1-4e46-8d25-5ace19ee7284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44270c602f0d43d8b638506a9ba19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:33Z,use_quota=True,user_id='e669a2db3c734345ae84c61c7f80303b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87808b08-7785-4c21-90bc-a33504c3a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87808b08-7785-4c21-90bc-a33504c3a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b656e-d731-48cd-8d82-c6f108d3459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968" returned: 0 in 7.960s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:45:33 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Converted 1024.00 MB image at 128.62 MB/s Aug 20 06:45:33 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 is being set with open permissions: ugo+rw Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:33 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 Aug 20 06:45:33 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:33 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968" returned: 0 in 0.335s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" released by "_copy_volume_from_snapshot" :: held 9.411s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b656e-d731-48cd-8d82-c6f108d3459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65bdee52-50b1-4e46-8d25-5ace19ee7284', 'volume_name': 'volume-65bdee52-50b1-4e46-8d25-5ace19ee7284', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28a34b0-d8d4-4747-8664-b2532f9e72bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28a34b0-d8d4-4747-8664-b2532f9e72bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefd914f-c60e-4d07-a06c-d4c7bc9dea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:33 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Volume 65bdee52-50b1-4e46-8d25-5ace19ee7284: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65bdee52-50b1-4e46-8d25-5ace19ee7284', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Trying to clone 65bdee52-50b1-4e46-8d25-5ace19ee7284 from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-e79574fd-8060-4e0e-94dc-926a804e7968" released by "_create_volume_from_snapshot" :: held 9.561s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.593s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67d234e-321e-43a8-9f2e-1c88f2d010d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79574fd-8060-4e0e-94dc-926a804e7968', 'volume_size': 1, 'snapshot_id': 'ce3daec7-7625-4011-a4e4-1a83a38a1ea4'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c832748-92d5-4b98-bf79-4e849a3995b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:34 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Volume volume-e79574fd-8060-4e0e-94dc-926a804e7968 (e79574fd-8060-4e0e-94dc-926a804e7968): created successfully Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c832748-92d5-4b98-bf79-4e849a3995b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Flow 'volume_create_manager' (52b45308-5492-47c6-8eb6-441677414239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8b36c52a-6105-475a-83e3-6053fe0657c3 tempest-VolumesDeleteCascade-1975823073 None] Created volume successfully. Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:34 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:34 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:45:34 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Image download 20.69 MB at 20.69 MB/s Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792e8d1-193f-4882-acaa-e92cacd25081]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:34 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD Aug 20 06:45:34 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:34 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:45:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-14598ee4-f915-4865-b596-f81f2631ad08-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-14598ee4-f915-4865-b596-f81f2631ad08-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Performing cascade delete. {{(pid=94234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:35 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD" returned: 0 in 0.627s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 is fetched for user e669a2db3c734345ae84c61c7f80303b. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Deleting offline snapshot ce3daec7-7625-4011-a4e4-1a83a38a1ea4 of volume 14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] snapshot_file for this snap is: volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c96dd-bf61-4e25-b637-8dc8493686f1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[55479bb5-8afa-44d3-9e25-bcb8944e4758]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:35 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:35 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:35 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD Aug 20 06:45:35 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:35 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1448585113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bdee52-50b1-4e46-8d25-5ace19ee7284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44270c602f0d43d8b638506a9ba19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:33Z,use_quota=True,user_id='e669a2db3c734345ae84c61c7f80303b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Creating volume 65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:35 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:35 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.570s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14598ee4-f915-4865-b596-f81f2631ad08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:35 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1073741824 Aug 20 06:45:35 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f368110-e1c1-4042-bcfa-c7a30ba18b27]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:36 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:36 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:36 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1073741824" returned: 0 in 0.694s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:36 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 Aug 20 06:45:36 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:36 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.908s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:36 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:36 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:36 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Attempting download of d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 65bdee52-50b1-4e46-8d25-5ace19ee7284. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[463c1c9f-a6ae-442b-8b34-c508e0b0d4ea]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:37 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz Aug 20 06:45:37 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:37 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:37 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4 Aug 20 06:45:37 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:37 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz" returned: 0 in 0.406s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:37 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz Aug 20 06:45:37 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:37 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08.ce3daec7-7625-4011-a4e4-1a83a38a1ea4" returned: 0 in 0.373s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-ce3daec7-7625-4011-a4e4-1a83a38a1ea4" released by "_delete_snapshot" :: held 2.450s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" released by "delete_snapshot" :: held 2.507s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:37 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['ba9a5645-b715-4076-9e7a-5629a16568b5', '0a08bca8-f02a-427f-9cee-dc1759ec3039', '72de7adc-a165-4092-a518-f2a24fdcab73', 'bedd15d2-21e8-4a2a-8aa0-4ef6872ca9c8'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Delete snapshot completed successfully. Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-ce3daec7-7625-4011-a4e4-1a83a38a1ea4-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Snapshots deleted, issuing volume delete {{(pid=94234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:38 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz" returned: 1 in 0.704s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93__l9ma9zz' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962d88f-d939-4d6a-9e2e-bf4aff2a6e6d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[795235cf-b722-40d8-a345-d77905c1e053]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:38 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD Aug 20 06:45:38 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:38 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:38 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-0464948c-3ca5-4ebb-9772-29c07f44bcc9 req-ddeb54cb-c5fd-447b-9ab1-d7922e16443f tempest-TestShelveInstance-1544697348 None] Terminate volume connection completed successfully. Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-0464948c-3ca5-4ebb-9772-29c07f44bcc9 req-ddeb54cb-c5fd-447b-9ab1-d7922e16443f tempest-TestShelveInstance-1544697348 None] Deleting attachment 78e85342-2fbd-420b-b88f-08f30a66cff6. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:45:38 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:38 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.616s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:45:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:38 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08 Aug 20 06:45:38 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:38 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 Aug 20 06:45:38 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:39 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-14598ee4-f915-4865-b596-f81f2631ad08" returned: 0 in 0.410s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-14598ee4-f915-4865-b596-f81f2631ad08" released by "delete_volume" :: held 1.131s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['434d1c54-7495-43cc-b3e8-22f460632fa6', '9a3634f7-4c05-46e7-8156-f236b583dc19', '1ace662b-c035-48ea-8852-faa5ee01b0d6', 'a76c83ad-3327-4c33-aef9-f2848e9d4bc5'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:39 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:39 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-e79574fd-8060-4e0e-94dc-926a804e7968-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-e79574fd-8060-4e0e-94dc-926a804e7968-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:39 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.402s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Deleted volume successfully. Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" acquired by "delete_volume" :: waited 0.040s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0b9e1622-2e89-4413-8ee4-71d289915f1d tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-14598ee4-f915-4865-b596-f81f2631ad08-delete_volume" released by "delete_volume" :: held 4.919s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3725926e-cee8-4caa-8926-d8418a57b39b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:40 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 Aug 20 06:45:40 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:40 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968" returned: 0 in 0.503s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:40 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968 Aug 20 06:45:40 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:40 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e79574fd-8060-4e0e-94dc-926a804e7968" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-quobyte-e79574fd-8060-4e0e-94dc-926a804e7968" released by "delete_volume" :: held 0.955s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:40 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Created reservations ['f320243f-181b-46d7-a17b-f4a5867e7d67', 'a5ccce41-e1df-4141-9e36-1044d17cecf9', '75aa6b0f-6b41-4635-9393-c4fa121d1f98', '36f580eb-2a49-46c5-9f03-55edcc0ba44e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:41 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:41 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:41 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.328s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Deleted volume successfully. Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-b266982c-4814-447e-9c2b-019fe94e0108 tempest-VolumesDeleteCascade-1975823073 None] Lock "cinder-e79574fd-8060-4e0e-94dc-926a804e7968-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:41 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284" returned: 0 in 2.601s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_tqv1u8ygdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:45:41 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Converted 112.00 MB image at 43.04 MB/s Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:41 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1G Aug 20 06:45:41 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-692cbfe3-6972-4c2e-bf79-1467dcd7f0d1 req-82b7c569-e732-4928-833b-3467ac33c3d4 tempest-TestShelveInstance-1544697348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-692cbfe3-6972-4c2e-bf79-1467dcd7f0d1 req-82b7c569-e732-4928-833b-3467ac33c3d4 tempest-TestShelveInstance-1544697348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-692cbfe3-6972-4c2e-bf79-1467dcd7f0d1 req-82b7c569-e732-4928-833b-3467ac33c3d4 tempest-TestShelveInstance-1544697348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-692cbfe3-6972-4c2e-bf79-1467dcd7f0d1 req-82b7c569-e732-4928-833b-3467ac33c3d4 tempest-TestShelveInstance-1544697348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca81d19e-13b3-4c85-86e0-5e9c0b91dc81', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:45:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-692cbfe3-6972-4c2e-bf79-1467dcd7f0d1 req-82b7c569-e732-4928-833b-3467ac33c3d4 tempest-TestShelveInstance-1544697348 None] attachment_update completed successfully. Aug 20 06:45:41 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 1G" returned: 0 in 0.427s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Downloaded image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 65bdee52-50b1-4e46-8d25-5ace19ee7284 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 for user e669a2db3c734345ae84c61c7f80303b is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Marking volume 65bdee52-50b1-4e46-8d25-5ace19ee7284 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Copying metadata from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 to 65bdee52-50b1-4e46-8d25-5ace19ee7284. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:45:41 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Creating volume glance metadata for volume 65bdee52-50b1-4e46-8d25-5ace19ee7284 backed by image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:45:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefd914f-c60e-4d07-a06c-d4c7bc9dea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bdee52-50b1-4e46-8d25-5ace19ee7284', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5f8ca7-585b-484b-a6cd-596f3417ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Volume volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 (65bdee52-50b1-4e46-8d25-5ace19ee7284): created successfully Aug 20 06:45:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5f8ca7-585b-484b-a6cd-596f3417ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Flow 'volume_create_manager' (cf296050-d297-484d-8ac5-58b8a4521f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6034c3a6-4184-4e40-a800-3e252c6a2c0b tempest-VolumesExtendTest-1499571581 None] Created volume successfully. Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0950525-51ac-4c8d-b30a-a23ebd2a434c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:43 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 Aug 20 06:45:43 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:43 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284" returned: 0 in 0.496s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 2G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 2G" returned: 0 in 0.167s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.699s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7948291d-c638-48aa-9037-202957198831 tempest-VolumesExtendTest-1499571581 None] Extend volume completed successfully. Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-65bdee52-50b1-4e46-8d25-5ace19ee7284-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-65bdee52-50b1-4e46-8d25-5ace19ee7284-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-quobyte-65bdee52-50b1-4e46-8d25-5ace19ee7284" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-65bdee52-50b1-4e46-8d25-5ace19ee7284" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[483230c3-4f58-4c9f-859f-d16171a11931]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:45 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 Aug 20 06:45:45 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:45 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284" returned: 0 in 0.595s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:45 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284 Aug 20 06:45:45 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:46 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-65bdee52-50b1-4e46-8d25-5ace19ee7284" returned: 0 in 0.683s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-65bdee52-50b1-4e46-8d25-5ace19ee7284" released by "delete_volume" :: held 1.366s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Created reservations ['88f736b2-943c-4022-9048-2f4bfe8479e4', '10a5b2a8-076c-47de-ad67-9dcdff8167aa', '43bc284c-4062-4349-8c2b-0698fb0ef66d', '0578a058-eaaa-4603-8943-1c7f15dfdeac'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:46 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:46 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:46 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.483s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Deleted volume successfully. Aug 20 06:45:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-137eaebf-3e43-42f5-926a-a3b1785bbbe2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-65bdee52-50b1-4e46-8d25-5ace19ee7284-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Flow 'volume_create_manager' (fb60e81d-6e04-47c6-935d-8c77d5140300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84134f2-feae-4cc7-b92b-42fbd2d5ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84134f2-feae-4cc7-b92b-42fbd2d5ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160116886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6827164-63b2-47b1-bccd-b2cc3f79ef69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44270c602f0d43d8b638506a9ba19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:48Z,use_quota=True,user_id='e669a2db3c734345ae84c61c7f80303b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fa97b-5b2b-4f97-a928-5656e9f4afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fa97b-5b2b-4f97-a928-5656e9f4afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbf55d8-30c9-4ce6-8366-65c33dba831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbf55d8-30c9-4ce6-8366-65c33dba831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6827164-63b2-47b1-bccd-b2cc3f79ef69', 'volume_name': 'volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a444f2e1-4857-4ceb-b64c-a10d9278baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a444f2e1-4857-4ceb-b64c-a10d9278baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ffc721-1e8c-46f3-b0ad-bb08ff442517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:47 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Volume a6827164-63b2-47b1-bccd-b2cc3f79ef69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69', 'volume_size': 1} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160116886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6827164-63b2-47b1-bccd-b2cc3f79ef69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44270c602f0d43d8b638506a9ba19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:48Z,use_quota=True,user_id='e669a2db3c734345ae84c61c7f80303b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Creating volume a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:47 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:47 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 1073741824 Aug 20 06:45:47 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Acquiring lock "cinder-acaef275-207c-4a91-8d19-473c029da5e4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "cinder-acaef275-207c-4a91-8d19-473c029da5e4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Acquiring lock "cinder-quobyte-acaef275-207c-4a91-8d19-473c029da5e4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "cinder-quobyte-acaef275-207c-4a91-8d19-473c029da5e4" acquired by "delete_volume" :: waited 0.040s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba95fa-8838-4abd-b974-35387b5bf48e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:48 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 1073741824" returned: 0 in 0.735s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:48 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:45:48 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:48 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 Aug 20 06:45:48 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:49 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4" returned: 0 in 0.803s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:49 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4 Aug 20 06:45:49 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:49 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.773s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ffc721-1e8c-46f3-b0ad-bb08ff442517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6e34cf-d9eb-4e66-87cd-b4d6bf1dd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:49 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Volume volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 (a6827164-63b2-47b1-bccd-b2cc3f79ef69): created successfully Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6e34cf-d9eb-4e66-87cd-b4d6bf1dd610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Flow 'volume_create_manager' (fb60e81d-6e04-47c6-935d-8c77d5140300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9ab7b658-d4b3-4709-8ab5-f3cb67327656 tempest-VolumesExtendTest-1499571581 None] Created volume successfully. Aug 20 06:45:49 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-acaef275-207c-4a91-8d19-473c029da5e4" returned: 0 in 0.481s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "cinder-quobyte-acaef275-207c-4a91-8d19-473c029da5e4" released by "delete_volume" :: held 1.381s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:49 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Created reservations ['f631aee7-1414-438d-ad27-20d13c32e0e9', '454c4267-9058-4b06-936c-e439ca3253cb', '70d27489-0b3a-468c-9d20-430ab80c37e5', 'b54ebde3-ec48-4d57-ba12-17e13e54f5f7'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:50 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:45:50 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Creating offline snapshot de13d6b1-7b68-4aae-8458-37c70da18299 of volume a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:45:50 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:45:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Deleted volume successfully. Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[99695248-346c-4b87-ab6b-001ee5b8a834]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-964f2cdb-0321-48e2-b2f0-c4f1d82512fe tempest-VolumesNegativeTest-1026005541 None] Lock "cinder-acaef275-207c-4a91-8d19-473c029da5e4-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:50 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:45:50 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:51 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.754s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:51 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 1G Aug 20 06:45:51 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:51 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 1G" returned: 0 in 0.545s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:51 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 Aug 20 06:45:51 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:52 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299" returned: 0 in 0.466s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:52 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 is being set with open permissions: ugo+rw Aug 20 06:45:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:52 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 Aug 20 06:45:52 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:52 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299" returned: 0 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:52 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info Aug 20 06:45:52 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:53 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info" returned: 0 in 0.407s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:53 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info is being set with open permissions: ugo+rw Aug 20 06:45:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:53 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info Aug 20 06:45:53 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:53 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.info" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-72a5521e-cd71-47fd-9b8c-ddfedc8085d3 tempest-VolumesExtendTest-1499571581 None] Create snapshot completed successfully Aug 20 06:45:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:54 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f47ff-1830-4e04-8473-cc3d75130cc5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:55 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:45:55 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:55 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.727s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 2G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Flow 'volume_create_manager' (474a26b2-3ea6-4e11-89f8-f84ef4f88667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907046da-1301-4198-b580-0180e3fc7e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907046da-1301-4198-b580-0180e3fc7e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-48674292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095b5bde-6f5c-4ef9-931f-a58e5c96b27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17b76eb84c24ebf9e62a3f29a065faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:56Z,use_quota=True,user_id='7748edb7bdf148318c6dc87a51ef1593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920f340b-7d7e-43f5-a8ef-b1f706ef7307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920f340b-7d7e-43f5-a8ef-b1f706ef7307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9629e46-d9fd-4689-84ba-ef2046fa2e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9629e46-d9fd-4689-84ba-ef2046fa2e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095b5bde-6f5c-4ef9-931f-a58e5c96b27c', 'volume_name': 'volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edd86f8-fd71-44fe-9c22-e6a1844108f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edd86f8-fd71-44fe-9c22-e6a1844108f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9f817f-036f-4a3c-9749-37410cb96c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c', 'volume_size': 1} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 2G" returned: 0 in 0.236s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-48674292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095b5bde-6f5c-4ef9-931f-a58e5c96b27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17b76eb84c24ebf9e62a3f29a065faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:45:56Z,use_quota=True,user_id='7748edb7bdf148318c6dc87a51ef1593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Creating volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:45:55 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:45:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:55 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c 1073741824 Aug 20 06:45:55 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a2e20ddc-fa3d-46e5-9dd9-175500ab62c3 tempest-VolumesExtendTest-1499571581 None] Extend volume completed successfully. Aug 20 06:45:56 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c 1073741824" returned: 0 in 0.691s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:56 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c Aug 20 06:45:56 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:57 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9f817f-036f-4a3c-9749-37410cb96c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df430eea-5651-469a-be49-c02d5abc794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:45:57 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Volume volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c (095b5bde-6f5c-4ef9-931f-a58e5c96b27c): created successfully Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df430eea-5651-469a-be49-c02d5abc794e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Flow 'volume_create_manager' (474a26b2-3ea6-4e11-89f8-f84ef4f88667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:45:57 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-43a5242f-7129-4d34-8a4a-47f13184e4c4 tempest-VolumesSnapshotListTestJSON-2048095322 None] Created volume successfully. Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-de13d6b1-7b68-4aae-8458-37c70da18299-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-de13d6b1-7b68-4aae-8458-37c70da18299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-quobyte-de13d6b1-7b68-4aae-8458-37c70da18299" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-de13d6b1-7b68-4aae-8458-37c70da18299" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Deleting offline snapshot de13d6b1-7b68-4aae-8458-37c70da18299 of volume a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] snapshot_file for this snap is: volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[92891e7f-e54f-4706-be7d-4f5cd693df34]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:57 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 Aug 20 06:45:57 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:57 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299" returned: 0 in 0.569s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:45:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1aed58-17ec-4073-81e7-88abe84f4066]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Creating offline snapshot 48c0835e-0297-4368-b421-58aa41cd18e2 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520b298-9add-4b9a-8375-53b8b4b9d9d4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:58 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c Aug 20 06:45:58 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:58 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:45:58 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:58 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" returned: 0 in 0.438s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:58 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 1G Aug 20 06:45:58 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:58 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.609s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:58 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 Aug 20 06:45:58 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:59 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 1G" returned: 0 in 0.537s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:59 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:45:59 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:59 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299" returned: 0 in 0.511s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:59 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299 Aug 20 06:45:59 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:59 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69.de13d6b1-7b68-4aae-8458-37c70da18299" returned: 0 in 0.323s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:59 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.430s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:59 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 is being set with open permissions: ugo+rw Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:45:59 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:45:59 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-de13d6b1-7b68-4aae-8458-37c70da18299" released by "_delete_snapshot" :: held 2.175s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" released by "delete_snapshot" :: held 2.209s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Created reservations ['77677b84-15ee-4a70-ac75-f8f190940c55', 'dfa4654e-63d3-4936-9260-bf484a5f66b9', '180c7858-ecd5-44d0-96b8-b9b976041d0c', '6f4f3f14-927e-4984-a738-70c572beaa26'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:45:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Delete snapshot completed successfully. Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-53efed7c-b8b0-4850-a169-9139265d45a2 tempest-VolumesExtendTest-1499571581 None] Lock "cinder-de13d6b1-7b68-4aae-8458-37c70da18299-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:45:59 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.428s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:45:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:00 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info Aug 20 06:46:00 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:00 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info" returned: 0 in 0.313s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:00 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info is being set with open permissions: ugo+rw Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:00 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info Aug 20 06:46:00 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:00 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.info" returned: 0 in 0.305s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e5104971-3e72-4049-a63c-1015075ac4bb tempest-VolumesSnapshotListTestJSON-2048095322 None] Create snapshot completed successfully Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-a6827164-63b2-47b1-bccd-b2cc3f79ef69-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "cinder-a6827164-63b2-47b1-bccd-b2cc3f79ef69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Acquiring lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357ee53-8060-48f2-a1e8-6add7d206c80]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:01 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:46:01 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:01 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.505s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:01 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69 Aug 20 06:46:01 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Creating offline snapshot 126e4ffb-4ecd-44ee-aa80-b53666fb4230 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Flow 'volume_create_manager' (b3defaa3-6fd0-4a5f-87ee-5cee6cbfc09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd222b2-8320-4d27-a093-b6ebd3257a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa9eee3-1e9b-46a4-b504-094e6b37c103]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:01 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a6827164-63b2-47b1-bccd-b2cc3f79ef69" returned: 0 in 0.284s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd222b2-8320-4d27-a093-b6ebd3257a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314556760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eccb7d6-fe9d-4fa5-90c3-12211c736635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b06d8d481a463d9b7d80b50e5d02ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:02Z,use_quota=True,user_id='ab5144afba074545a985d25fe088a09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e5e716-efb6-463c-a311-9ff2ec045c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e5e716-efb6-463c-a311-9ff2ec045c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcfbe8b-09c9-45b0-b3df-230ca9f290c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcfbe8b-09c9-45b0-b3df-230ca9f290c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eccb7d6-fe9d-4fa5-90c3-12211c736635', 'volume_name': 'volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3e9a59-f39d-4913-9674-8254ba629e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3e9a59-f39d-4913-9674-8254ba629e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f68729-a029-42f1-a423-0cee0863f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:01 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635', 'volume_size': 1} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "cinder-quobyte-a6827164-63b2-47b1-bccd-b2cc3f79ef69" released by "delete_volume" :: held 0.918s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:01 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:46:01 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Created reservations ['4d951d7a-0d83-4dea-acd7-177a09aaf797', 'f77c6aa0-cdb5-4ae2-8ca4-29ef6517afbd', 'fd0b2551-7ba6-41dc-b5f6-c23344167774', '97608f08-be9b-4ea5-8376-2d7de84ad8ba'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:01 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:01 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:02 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.396s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:02 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 1G Aug 20 06:46:02 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:02 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Deleted volume successfully. Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4738531a-6fe1-4041-9ff0-4a795456eefb tempest-VolumesExtendTest-1499571581 None] Lock "cinder-a6827164-63b2-47b1-bccd-b2cc3f79ef69-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:02 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 1G" returned: 0 in 0.514s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:02 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:02 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:02 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:02 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 is being set with open permissions: ugo+rw Aug 20 06:46:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:02 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:02 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:03 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.279s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.711s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314556760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eccb7d6-fe9d-4fa5-90c3-12211c736635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b06d8d481a463d9b7d80b50e5d02ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:02Z,use_quota=True,user_id='ab5144afba074545a985d25fe088a09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Creating volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:03 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:03 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 1073741824 Aug 20 06:46:03 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-358e98af-6538-4bca-8827-2dd68d059572 tempest-VolumesSnapshotListTestJSON-2048095322 None] Create snapshot completed successfully Aug 20 06:46:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:04 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 1073741824" returned: 0 in 0.715s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:04 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:46:04 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:04 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.272s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.476s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Creating offline snapshot c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f68729-a029-42f1-a423-0cee0863f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaccea6-3670-43ea-8d86-33ab274110af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d18268-d5b3-433f-b3a5-6e0634fb2e65]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:04 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Volume volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 (9eccb7d6-fe9d-4fa5-90c3-12211c736635): created successfully Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaccea6-3670-43ea-8d86-33ab274110af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Flow 'volume_create_manager' (b3defaa3-6fd0-4a5f-87ee-5cee6cbfc09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-418bb366-c6ce-4597-93fd-1269b8291f77 tempest-VolumesActionsTest-19318111 None] Created volume successfully. Aug 20 06:46:04 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:04 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:04 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.458s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:04 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 1G Aug 20 06:46:04 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:05 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 1G" returned: 0 in 0.709s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:05 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 Aug 20 06:46:05 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (68d25625-90ef-4fb9-8528-1e637e24b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e89d3b6-dea5-4bc1-b499-163c92959b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e89d3b6-dea5-4bc1-b499-163c92959b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-659260955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39f5c6-45af-490b-8d57-d48139b971b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:06Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e3ab1d-4e18-4e0d-915d-6af9c12f898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e3ab1d-4e18-4e0d-915d-6af9c12f898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18149341-9ef4-4f9d-b733-0adcb4d79d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18149341-9ef4-4f9d-b733-0adcb4d79d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb39f5c6-45af-490b-8d57-d48139b971b4', 'volume_name': 'volume-eb39f5c6-45af-490b-8d57-d48139b971b4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cb77a-35d4-4d07-8e63-d42eb5069838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cb77a-35d4-4d07-8e63-d42eb5069838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d313fa3b-697f-4426-a83d-3bad7817b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:05 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Volume eb39f5c6-45af-490b-8d57-d48139b971b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb39f5c6-45af-490b-8d57-d48139b971b4', 'volume_size': 1} Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:05 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:05 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 is being set with open permissions: ugo+rw Aug 20 06:46:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:05 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 Aug 20 06:46:05 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:06 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" returned: 0 in 0.274s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-659260955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39f5c6-45af-490b-8d57-d48139b971b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:06Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Creating volume eb39f5c6-45af-490b-8d57-d48139b971b4 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:06 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:06 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 1073741824 Aug 20 06:46:06 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e814d386-7765-4dbc-b4b8-19eada6c8f12 tempest-VolumesSnapshotListTestJSON-2048095322 None] Create snapshot completed successfully Aug 20 06:46:06 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 1073741824" returned: 0 in 0.503s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:06 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 Aug 20 06:46:06 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:07 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d313fa3b-697f-4426-a83d-3bad7817b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb39f5c6-45af-490b-8d57-d48139b971b4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23638cdd-5bcc-48da-8361-f51ec86cc2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Volume volume-eb39f5c6-45af-490b-8d57-d48139b971b4 (eb39f5c6-45af-490b-8d57-d48139b971b4): created successfully Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23638cdd-5bcc-48da-8361-f51ec86cc2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (68d25625-90ef-4fb9-8528-1e637e24b637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0f341eba-ae80-4214-9734-e1360736155c tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Deleting offline snapshot c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] snapshot_file for this snap is: volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f085b-7545-40be-b2bf-2d421030fabb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:08 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 Aug 20 06:46:08 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:08 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" returned: 0 in 0.506s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d81b2e4-2f6f-42e9-a720-b275d61657d0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:08 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:08 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (16ac536d-aee7-48c9-83b2-d3c6dda976f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0530ce3-79f5-4203-a62b-cedd09d42ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0530ce3-79f5-4203-a62b-cedd09d42ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778942041',display_name='tempest-VolumesGetTest-Volume-1684698432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f793506-16a5-4a9e-aa67-c6b3f2d4dde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:09Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1936a2-95bf-42b4-bd96-b8411ae9ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1936a2-95bf-42b4-bd96-b8411ae9ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ded752-8904-4806-85ce-362b737fc2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ded752-8904-4806-85ce-362b737fc2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f793506-16a5-4a9e-aa67-c6b3f2d4dde6', 'volume_name': 'volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61723053-6110-4483-a519-d240e4b22b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61723053-6110-4483-a519-d240e4b22b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd75a6f-d1d1-4e2e-8f95-34ec5c6e0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Volume 2f793506-16a5-4a9e-aa67-c6b3f2d4dde6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6', 'volume_size': 1} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778942041',display_name='tempest-VolumesGetTest-Volume-1684698432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f793506-16a5-4a9e-aa67-c6b3f2d4dde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:09Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Creating volume 2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:09 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 1073741824 Aug 20 06:46:09 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:09 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.450s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:09 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 Aug 20 06:46:09 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:09 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:09 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 1073741824" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" returned: 0 in 0.498s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:09 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37 Aug 20 06:46:09 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:09 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 Aug 20 06:46:09 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:09 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" returned: 0 in 0.356s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:09 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" returned: 0 in 0.332s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37" released by "_delete_snapshot" :: held 1.949s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd75a6f-d1d1-4e2e-8f95-34ec5c6e0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c246bef-0c3b-4fa8-9a1c-abaf72a9d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" released by "delete_snapshot" :: held 1.996s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Volume volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 (2f793506-16a5-4a9e-aa67-c6b3f2d4dde6): created successfully Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c246bef-0c3b-4fa8-9a1c-abaf72a9d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (16ac536d-aee7-48c9-83b2-d3c6dda976f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-02ccf9a7-fea9-49a8-bb6d-72540057c500 tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:46:10 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Created reservations ['b628e88c-91e1-4ea7-b91f-334c1052105e', '1f231dc1-aa50-4272-b2e3-a8d2dc99d801', '8349d123-61a8-4930-8840-7292a18b476e', '5cf07674-b5ee-427b-a8b7-92a0f2ee90db'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Delete snapshot completed successfully. Aug 20 06:46:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-89dd2bda-8591-46d4-b827-9edcbf303559 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-c92c4956-75fc-4dbf-8c8a-c2fd2c582f37-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-126e4ffb-4ecd-44ee-aa80-b53666fb4230-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-126e4ffb-4ecd-44ee-aa80-b53666fb4230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-126e4ffb-4ecd-44ee-aa80-b53666fb4230" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-126e4ffb-4ecd-44ee-aa80-b53666fb4230" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Deleting offline snapshot 126e4ffb-4ecd-44ee-aa80-b53666fb4230 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] snapshot_file for this snap is: volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b28235-a54d-4099-a68c-45ece3eab276]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "cinder-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c5c19-814d-4ac3-a266-1cc847582612]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:11 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:11 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:11 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 Aug 20 06:46:11 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:11 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.481s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a223a5d-d3cc-4f11-81ec-72621a045dd1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:11 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:11 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6 Aug 20 06:46:11 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:11 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:46:11 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:12 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6" released by "delete_volume" :: held 0.752s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:12 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.379s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:12 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:12 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Created reservations ['8792fc13-f311-4075-9a41-5988c9b5a88c', '199f6e99-cf53-421c-9047-daedc80e04aa', '0babe45f-24ca-486b-a93f-2ffe0a60c9c3', 'c3d6f191-090e-4054-826f-903aa56547ad'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:12 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:12 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-eb39f5c6-45af-490b-8d57-d48139b971b4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "cinder-eb39f5c6-45af-490b-8d57-d48139b971b4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-eb39f5c6-45af-490b-8d57-d48139b971b4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-eb39f5c6-45af-490b-8d57-d48139b971b4" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:12 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.462s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7d9ded-b2f0-4693-8456-9f6dbdbce471]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=127,cinder:INSERT=40,cinder:UPDATE=132,cinder:DELETE=15 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:46:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3cbab1f3-cf05-455d-ad59-b99718070c0a tempest-VolumesGetTest-1734161192 None] Lock "cinder-2f793506-16a5-4a9e-aa67-c6b3f2d4dde6-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:13 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.745s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:13 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 Aug 20 06:46:13 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:13 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230 Aug 20 06:46:13 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:13 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4" returned: 0 in 0.538s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:13 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.126e4ffb-4ecd-44ee-aa80-b53666fb4230" returned: 0 in 0.443s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:13 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4 Aug 20 06:46:13 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-126e4ffb-4ecd-44ee-aa80-b53666fb4230" released by "_delete_snapshot" :: held 2.207s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" released by "delete_snapshot" :: held 2.244s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:INSERT=39,cinder:UPDATE=144,cinder:SELECT=121,cinder:DELETE=9 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Created reservations ['023932fb-b4e0-4541-b154-e528ac931867', '4a8d0edf-a912-405c-95c0-633fe0498543', '160d70fa-33b9-4f44-8dd0-bd4ba344788a', 'bd67b1f6-490b-4c28-a772-ad6e8b5154d4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Delete snapshot completed successfully. Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-22c4f05c-3bda-4f41-b257-cd98a0429fcc tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-126e4ffb-4ecd-44ee-aa80-b53666fb4230-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:13 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eb39f5c6-45af-490b-8d57-d48139b971b4" returned: 0 in 0.398s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-eb39f5c6-45af-490b-8d57-d48139b971b4" released by "delete_volume" :: held 1.014s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Created reservations ['09eeeb7b-f0e0-4b98-8a3a-27ebe51dede3', '41d29ae6-88a9-474e-a711-3a47e6af52d1', '21961763-ca72-467c-9831-2537ed92df6c', '35613d8b-14a5-43cd-aa97-d068beaa95c1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:14 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:14 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:14 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1665fdb6-ab00-4bdc-a847-4eb908187969 tempest-VolumesGetTest-1734161192 None] Lock "cinder-eb39f5c6-45af-490b-8d57-d48139b971b4-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-61712a12-b970-4f12-a96d-19a7246b2df5 tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" by "attach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-61712a12-b970-4f12-a96d-19a7246b2df5 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" acquired by "attach_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-61712a12-b970-4f12-a96d-19a7246b2df5 tempest-VolumesActionsTest-19318111 None] Attaching volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635 to instance 2a8eb6cc-9bf3-4350-8a8b-8f3fac0503e2 at mountpoint /dev/vdb on host None. Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-48c0835e-0297-4368-b421-58aa41cd18e2-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-48c0835e-0297-4368-b421-58aa41cd18e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-61712a12-b970-4f12-a96d-19a7246b2df5 tempest-VolumesActionsTest-19318111 None] Attach volume completed successfully. Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-61712a12-b970-4f12-a96d-19a7246b2df5 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" released by "attach_volume" :: held 0.141s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-48c0835e-0297-4368-b421-58aa41cd18e2" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-48c0835e-0297-4368-b421-58aa41cd18e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Deleting offline snapshot 48c0835e-0297-4368-b421-58aa41cd18e2 of volume 095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] snapshot_file for this snap is: volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a5f04-118e-4bfc-979a-0d29856907ea]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bd4ad0fc-3f5d-4571-b818-dcf35427658e tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" by "detach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:14 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:46:14 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bd4ad0fc-3f5d-4571-b818-dcf35427658e tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bd4ad0fc-3f5d-4571-b818-dcf35427658e tempest-VolumesActionsTest-19318111 None] Detaching volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635 from instance 2a8eb6cc-9bf3-4350-8a8b-8f3fac0503e2. Aug 20 06:46:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bd4ad0fc-3f5d-4571-b818-dcf35427658e tempest-VolumesActionsTest-19318111 None] Detach volume completed successfully. Aug 20 06:46:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bd4ad0fc-3f5d-4571-b818-dcf35427658e tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:15 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.623s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d81e0e-3f5b-407f-9a00-79c13847c29e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:15 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c Aug 20 06:46:15 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (7e7de600-e7a4-4363-a736-869d30bb51c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec65bbc-62b0-4c46-a3c7-a98f5bf06dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec65bbc-62b0-4c46-a3c7-a98f5bf06dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-433335951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f57af38-acb3-40be-a1d9-5f0f255fb9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:16Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:15 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02859330-7d94-45b3-9284-c72e1f3a703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02859330-7d94-45b3-9284-c72e1f3a703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b55a4a-3136-423f-901d-13eaa51f7686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b55a4a-3136-423f-901d-13eaa51f7686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'volume_name': 'volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e26a05d-e3de-47ba-8cea-10323f6841e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e26a05d-e3de-47ba-8cea-10323f6841e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef7e183-0f3f-4c6a-876d-cf0935c34581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:15 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Volume 4f57af38-acb3-40be-a1d9-5f0f255fb9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'volume_size': 1} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-433335951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f57af38-acb3-40be-a1d9-5f0f255fb9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:16Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Creating volume 4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:15 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" returned: 0 in 0.610s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:15 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc 1073741824 Aug 20 06:46:15 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:16 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:46:16 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:16 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.604s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:16 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2 Aug 20 06:46:16 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:16 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc 1073741824" returned: 0 in 0.684s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:16 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:16 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:17 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c.48c0835e-0297-4368-b421-58aa41cd18e2" returned: 0 in 0.451s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-48c0835e-0297-4368-b421-58aa41cd18e2" released by "_delete_snapshot" :: held 2.463s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" released by "delete_snapshot" :: held 2.492s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:17 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef7e183-0f3f-4c6a-876d-cf0935c34581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff4025c-97b1-4313-ad94-d2b066b2933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:17 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Volume volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc (4f57af38-acb3-40be-a1d9-5f0f255fb9dc): created successfully Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff4025c-97b1-4313-ad94-d2b066b2933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (7e7de600-e7a4-4363-a736-869d30bb51c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3f796fc3-76fb-49af-90a9-f63172c9ece5 tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Created reservations ['092b4afb-bc2e-4d79-b6b5-a9cdc306db82', '36041c67-88d6-4aa7-a8c2-7956d2085adc', '67076a78-1f73-44df-84ad-671a99569fc0', '9422c2a0-6259-4eca-83c3-2060d190d712'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Delete snapshot completed successfully. Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f9dffb69-e933-4774-9ee8-e2f8de3dd7a8 tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-48c0835e-0297-4368-b421-58aa41cd18e2-delete_snapshot" released by "delete_snapshot" :: held 2.772s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-095b5bde-6f5c-4ef9-931f-a58e5c96b27c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-095b5bde-6f5c-4ef9-931f-a58e5c96b27c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[99819294-4698-451c-979e-06834d48e97a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:18 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c Aug 20 06:46:18 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:18 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" returned: 0 in 0.430s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:18 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c Aug 20 06:46:18 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (996f7272-31c2-4593-91b7-816aea4daaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f4b35-c3c8-4e52-a333-975daa4b6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f4b35-c3c8-4e52-a333-975daa4b6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-497762784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5b97f2-3b6b-412f-99ae-5bc7cda919d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4f57af38-acb3-40be-a1d9-5f0f255fb9dc,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:18Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d9474-9e08-4474-9583-c94835a9f6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d9474-9e08-4474-9583-c94835a9f6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244cc186-a34d-49f3-a82a-7150033b6f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244cc186-a34d-49f3-a82a-7150033b6f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de5b97f2-3b6b-412f-99ae-5bc7cda919d6', 'volume_name': 'volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6', 'volume_size': 1, 'source_volid': '4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'source_volstatus': 'available'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db323aa-1d2c-4f28-a5ba-70fea38f8ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db323aa-1d2c-4f28-a5ba-70fea38f8ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c4a1ae-66ab-4e4e-a2e8-08968a504041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Volume de5b97f2-3b6b-412f-99ae-5bc7cda919d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6', 'volume_size': 1, 'source_volid': '4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'source_volstatus': 'available'} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:18 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Cloning volume 4f57af38-acb3-40be-a1d9-5f0f255fb9dc to volume de5b97f2-3b6b-412f-99ae-5bc7cda919d6 Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Creating offline snapshot de4ff2fa-bf11-48e1-8982-f42c76df0395 of volume 4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b5634-8610-4ea9-b5d5-fde191b5cb38]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:18 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" returned: 0 in 0.327s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-quobyte-095b5bde-6f5c-4ef9-931f-a58e5c96b27c" released by "delete_volume" :: held 0.835s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:18 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Created reservations ['fba51583-eba2-45bf-9219-2674ac214689', '690f6212-3e84-4e21-9e49-83c59fe1f61f', '147ae2f8-c3a8-42b8-94b7-84b03111ca12', '3202b20e-3779-4f05-8707-97127a0112ae'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:18 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:18 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:19 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:19 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:19 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.508s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:19 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 1G Aug 20 06:46:19 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:19 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.370s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Deleted volume successfully. Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c8d780cc-1fab-4af1-9578-fb7f4350b61c tempest-VolumesSnapshotListTestJSON-2048095322 None] Lock "cinder-095b5bde-6f5c-4ef9-931f-a58e5c96b27c-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:19 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 1G" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:19 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:19 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:20 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:20 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 is being set with open permissions: ugo+rw Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:20 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:20 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:20 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:20 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info Aug 20 06:46:20 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:20 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:20 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info is being set with open permissions: ugo+rw Aug 20 06:46:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:21 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info Aug 20 06:46:21 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:21 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.info" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] snapshot: de4ff2fa-bf11-48e1-8982-f42c76df0395, volume: de5b97f2-3b6b-412f-99ae-5bc7cda919d6, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a170314-05c2-4e60-a0ab-9fc566f6ee86]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:21 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:21 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:22 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.628s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e760603-0138-4ac4-acee-17d44e59b076]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:22 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:22 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:22 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.457s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:46:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:22 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 Aug 20 06:46:22 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Flow 'volume_create_manager' (dc72e4c1-e596-4490-ae84-801eae0f4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4cf673-5d64-4a80-99d3-4c0b3379bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4cf673-5d64-4a80-99d3-4c0b3379bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-188676976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d568b1-eecf-4e15-b1ab-1e1912021439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234ae77cf0d145b3bf11ce4da7a7e04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:23Z,use_quota=True,user_id='915c5c4c5f0d43049a33250177838444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659524a9-9ae8-439a-8507-52b8b472f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659524a9-9ae8-439a-8507-52b8b472f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0323fbde-cd63-48d4-bd16-5aef9cc1a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0323fbde-cd63-48d4-bd16-5aef9cc1a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d568b1-eecf-4e15-b1ab-1e1912021439', 'volume_name': 'volume-64d568b1-eecf-4e15-b1ab-1e1912021439', 'volume_size': 2}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b1e06d-b4e8-4afa-9ff2-e62da3b67059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b1e06d-b4e8-4afa-9ff2-e62da3b67059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ef775e-4922-43ee-8df4-7014d088c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Volume 64d568b1-eecf-4e15-b1ab-1e1912021439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d568b1-eecf-4e15-b1ab-1e1912021439', 'volume_size': 2} Aug 20 06:46:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:28 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" returned: 0 in 6.203s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:28 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:46:28 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Converted 1024.00 MB image at 165.05 MB/s Aug 20 06:46:28 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 is being set with open permissions: ugo+rw Aug 20 06:46:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:28 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 Aug 20 06:46:28 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:29 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" returned: 0 in 0.315s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" released by "_copy_volume_from_snapshot" :: held 7.700s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-de4ff2fa-bf11-48e1-8982-f42c76df0395" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de4ff2fa-bf11-48e1-8982-f42c76df0395" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Deleting offline snapshot de4ff2fa-bf11-48e1-8982-f42c76df0395 of volume 4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] snapshot_file for this snap is: volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe484c3-713a-4a04-9434-9b713f6923a3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:29 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:29 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:29 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a6b19-0efe-4abe-8193-17116cabf2b3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:29 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:29 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:30 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.870s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:30 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:30 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-867384b5-b0b8-4b90-a69f-67fb08e19016 tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" by "attach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-867384b5-b0b8-4b90-a69f-67fb08e19016 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" acquired by "attach_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:31 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.702s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:31 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395 Aug 20 06:46:31 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-867384b5-b0b8-4b90-a69f-67fb08e19016 tempest-VolumesActionsTest-19318111 None] Attaching volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635 to instance f22f6c41-5194-473a-a36c-270290be8159 at mountpoint /dev/vdb on host None. Aug 20 06:46:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-867384b5-b0b8-4b90-a69f-67fb08e19016 tempest-VolumesActionsTest-19318111 None] Attach volume completed successfully. Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-867384b5-b0b8-4b90-a69f-67fb08e19016 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635" released by "attach_volume" :: held 0.206s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:31 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc.de4ff2fa-bf11-48e1-8982-f42c76df0395" returned: 0 in 0.469s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de4ff2fa-bf11-48e1-8982-f42c76df0395" released by "_delete_snapshot" :: held 2.782s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-666ee35e-2183-4c44-a6b7-1446f148f651 tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" by "detach_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-666ee35e-2183-4c44-a6b7-1446f148f651 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-666ee35e-2183-4c44-a6b7-1446f148f651 tempest-VolumesActionsTest-19318111 None] Detaching volume 9eccb7d6-fe9d-4fa5-90c3-12211c736635 from instance f22f6c41-5194-473a-a36c-270290be8159. Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.369s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.313s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-188676976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d568b1-eecf-4e15-b1ab-1e1912021439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234ae77cf0d145b3bf11ce4da7a7e04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:23Z,use_quota=True,user_id='915c5c4c5f0d43049a33250177838444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Creating volume 64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 2147483648 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c4a1ae-66ab-4e4e-a2e8-08968a504041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6', 'volume_size': 1, 'source_volid': '4f57af38-acb3-40be-a1d9-5f0f255fb9dc', 'source_volstatus': 'available'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47470e03-01a4-4df6-8902-64b545259683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:32 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 2147483648 Aug 20 06:46:32 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Volume volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 (de5b97f2-3b6b-412f-99ae-5bc7cda919d6): created successfully Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47470e03-01a4-4df6-8902-64b545259683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (996f7272-31c2-4593-91b7-816aea4daaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-666ee35e-2183-4c44-a6b7-1446f148f651 tempest-VolumesActionsTest-19318111 None] Detach volume completed successfully. Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6fa8cb82-eea7-452d-ac30-250c58cbd7df tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-666ee35e-2183-4c44-a6b7-1446f148f651 tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-detach_volume" released by "detach_volume" :: held 0.257s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-41131fcf-fceb-41b4-be46-367c94f92983 req-4f2633cd-5220-4bae-b6d5-1d2eb16a0c53 tempest-TestShelveInstance-1544697348 None] Terminate volume connection completed successfully. Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-41131fcf-fceb-41b4-be46-367c94f92983 req-4f2633cd-5220-4bae-b6d5-1d2eb16a0c53 tempest-TestShelveInstance-1544697348 None] Deleting attachment ca81d19e-13b3-4c85-86e0-5e9c0b91dc81. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:46:32 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 2147483648" returned: 0 in 0.883s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:33 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 Aug 20 06:46:33 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Acquiring lock "cinder-445c7638-6226-4cce-a9b0-c9b2b291c1b7-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "cinder-445c7638-6226-4cce-a9b0-c9b2b291c1b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Acquiring lock "cinder-quobyte-445c7638-6226-4cce-a9b0-c9b2b291c1b7" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "cinder-quobyte-445c7638-6226-4cce-a9b0-c9b2b291c1b7" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbce93-92c0-478e-ba1f-414a190a1ba8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:33 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 Aug 20 06:46:33 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:33 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439" returned: 0 in 0.520s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ef775e-4922-43ee-8df4-7014d088c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d568b1-eecf-4e15-b1ab-1e1912021439', 'volume_size': 2}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc983636-8057-467e-85e5-bc962b8e34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:33 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Volume volume-64d568b1-eecf-4e15-b1ab-1e1912021439 (64d568b1-eecf-4e15-b1ab-1e1912021439): created successfully Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc983636-8057-467e-85e5-bc962b8e34fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Flow 'volume_create_manager' (dc72e4c1-e596-4490-ae84-801eae0f4db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-48d127e7-e544-48cb-a359-41beedcfdeb7 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Created volume successfully. Aug 20 06:46:33 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7" returned: 0 in 0.696s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:34 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7 Aug 20 06:46:34 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:34 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-445c7638-6226-4cce-a9b0-c9b2b291c1b7" returned: 0 in 0.376s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "cinder-quobyte-445c7638-6226-4cce-a9b0-c9b2b291c1b7" released by "delete_volume" :: held 1.194s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:34 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:34 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (d9ea4cfc-9443-4209-befa-6098945be7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1601b10b-2499-49ad-90c7-e3d857a7bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1601b10b-2499-49ad-90c7-e3d857a7bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1325446875',display_name='tempest-VolumesGetTest-Volume-1342665869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a4dd79-ec04-4de1-9f57-a0145f115583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:34Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f0806b-0d9e-4ae3-a1c7-de648d440043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f0806b-0d9e-4ae3-a1c7-de648d440043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf8f265-b8f8-4d3c-8852-93bc268baa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf8f265-b8f8-4d3c-8852-93bc268baa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a4dd79-ec04-4de1-9f57-a0145f115583', 'volume_name': 'volume-93a4dd79-ec04-4de1-9f57-a0145f115583', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ee67b-9892-4b0a-911c-5ba86c4795f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ee67b-9892-4b0a-911c-5ba86c4795f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735cdc9-4870-44e3-b81a-d97bf0b3deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:34 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Volume 93a4dd79-ec04-4de1-9f57-a0145f115583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a4dd79-ec04-4de1-9f57-a0145f115583', 'volume_size': 1} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1325446875',display_name='tempest-VolumesGetTest-Volume-1342665869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a4dd79-ec04-4de1-9f57-a0145f115583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:34Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Creating volume 93a4dd79-ec04-4de1-9f57-a0145f115583 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:46:34 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.quota [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Created reservations ['8f7d744e-779e-4051-afab-81df0ee58518', '0e1282d7-2ab2-4acf-bce5-497ef499a4e7', '17dd64a9-4b65-4223-8cde-5afd76986cce', 'f6a9ebaf-2a8c-4d68-92f0-e2850e39e4b8'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:34 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 1073741824 Aug 20 06:46:34 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:34 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.542s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:34 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:34 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:46:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:35 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.manager [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Deleted volume successfully. Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [req-41131fcf-fceb-41b4-be46-367c94f92983 req-b8bf172a-9688-44af-9fc0-6369a390d7ca tempest-TestShelveInstance-1544697348 None] Lock "cinder-445c7638-6226-4cce-a9b0-c9b2b291c1b7-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:35 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 1073741824" returned: 0 in 0.846s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:35 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 Aug 20 06:46:35 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:35 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583" returned: 0 in 0.261s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735cdc9-4870-44e3-b81a-d97bf0b3deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a4dd79-ec04-4de1-9f57-a0145f115583', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5e68c6-d3b7-4d32-a5f1-60c1139dcf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Creating offline snapshot d66b83b9-3940-429f-8020-16d0dce2087a of volume 64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:46:35 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Volume volume-93a4dd79-ec04-4de1-9f57-a0145f115583 (93a4dd79-ec04-4de1-9f57-a0145f115583): created successfully Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5e68c6-d3b7-4d32-a5f1-60c1139dcf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (d9ea4cfc-9443-4209-befa-6098945be7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edd1735-3002-4497-afa2-76017461a907]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6cb42a61-60ca-4045-a2dd-2caf873cfc00 tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:46:36 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 Aug 20 06:46:36 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:36 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439" returned: 0 in 0.440s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a 2G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:36 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a 2G Aug 20 06:46:36 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-93a4dd79-ec04-4de1-9f57-a0145f115583-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "cinder-93a4dd79-ec04-4de1-9f57-a0145f115583-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-93a4dd79-ec04-4de1-9f57-a0145f115583" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-93a4dd79-ec04-4de1-9f57-a0145f115583" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885d728-27d6-4894-bf2e-1743137f4768]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:36 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a 2G" returned: 0 in 0.608s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d568b1-eecf-4e15-b1ab-1e1912021439 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:37 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d568b1-eecf-4e15-b1ab-1e1912021439 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a Aug 20 06:46:37 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:37 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 Aug 20 06:46:37 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:37 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d568b1-eecf-4e15-b1ab-1e1912021439 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a" returned: 0 in 0.407s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:37 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a is being set with open permissions: ugo+rw Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:37 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a Aug 20 06:46:37 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:37 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:37 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583 Aug 20 06:46:37 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:37 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:37 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-93a4dd79-ec04-4de1-9f57-a0145f115583" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-93a4dd79-ec04-4de1-9f57-a0145f115583" released by "delete_volume" :: held 0.910s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:37 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info Aug 20 06:46:37 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Created reservations ['170590bd-cd7a-46f7-8643-940fc1bef030', 'fa64c741-207d-4d30-aac5-3a8f4c73268f', '225cf85f-4fbc-4d46-875c-a1b6f39bcc8d', '3a4d74ca-4e50-47a5-8a3b-ab68c3a51e17'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:38 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:38 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-de5b97f2-3b6b-412f-99ae-5bc7cda919d6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:38 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info" returned: 0 in 0.456s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:38 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info is being set with open permissions: ugo+rw Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "cinder-de5b97f2-3b6b-412f-99ae-5bc7cda919d6-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:38 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info Aug 20 06:46:38 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[207ffc1c-41af-45fb-a928-4281fd2f77dc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:38 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.421s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2d28700d-c7ab-48d6-993a-0dfd8d71aebe tempest-VolumesGetTest-1734161192 None] Lock "cinder-93a4dd79-ec04-4de1-9f57-a0145f115583-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:38 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 Aug 20 06:46:38 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:38 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.info" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.426s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca6022-742d-4399-9045-3e24c0dfaddc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1513e425-8766-4de6-ae01-65580b3a98fe tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Create snapshot completed successfully Aug 20 06:46:38 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:46:38 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:38 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" returned: 0 in 0.388s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:38 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6 Aug 20 06:46:38 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:38 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.386s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[39980d47-a6e8-4fea-8497-9b3c46f74e6f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:39 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-de5b97f2-3b6b-412f-99ae-5bc7cda919d6" released by "delete_volume" :: held 0.720s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:39 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:46:39 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Created reservations ['2312e7b9-bfdc-4b84-b14a-463ff2e38128', '4532ee7d-62cd-4fc4-a5a0-51bf16730f5a', 'c46a78da-38a8-40f9-9305-41160349d32a', '1380e8e6-f110-40fa-b5d8-977ade80ba95'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:39 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:39 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "cinder-d66b83b9-3940-429f-8020-16d0dce2087a-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-4f57af38-acb3-40be-a1d9-5f0f255fb9dc-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-d66b83b9-3940-429f-8020-16d0dce2087a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:39 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.619s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9k_19245j.img {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "cinder-4f57af38-acb3-40be-a1d9-5f0f255fb9dc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:39 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9k_19245j.img Aug 20 06:46:39 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" acquired by "delete_snapshot" :: waited 0.065s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "cinder-quobyte-d66b83b9-3940-429f-8020-16d0dce2087a" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-d66b83b9-3940-429f-8020-16d0dce2087a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Deleting offline snapshot d66b83b9-3940-429f-8020-16d0dce2087a of volume 64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] snapshot_file for this snap is: volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:46:39 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c7e71-1a91-4458-9ac6-53848ed30a61]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.465s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" acquired by "delete_volume" :: waited 0.051s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-343bf22e-b3fc-4242-a9e3-5c9c737fda74 tempest-VolumesGetTest-1734161192 None] Lock "cinder-de5b97f2-3b6b-412f-99ae-5bc7cda919d6-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8507ead6-68ad-47d2-8507-496f346ff1d8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:39 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a Aug 20 06:46:39 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:40 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:40 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:40 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a" returned: 0 in 0.805s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64d568b1-eecf-4e15-b1ab-1e1912021439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7b81a6-53ae-4fff-b6f5-65b6965639bb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:40 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.951s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:40 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc Aug 20 06:46:40 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:40 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 Aug 20 06:46:40 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:41 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" returned: 0 in 0.652s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-4f57af38-acb3-40be-a1d9-5f0f255fb9dc" released by "delete_volume" :: held 1.767s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Created reservations ['90adfbbf-67da-4e47-9166-27d0bb0f0db2', '91f1fc87-a014-4565-93ec-48155cf474ff', '59c51ff3-9695-4f0d-b2c8-78b291a1042c', 'a55da228-ba92-4b20-976a-0786ba98e036'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:41 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439" returned: 0 in 1.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:41 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:42 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a Aug 20 06:46:42 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:42 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:42 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:42 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a" returned: 0 in 1.024s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 1.086s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:42 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:46:43 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a Aug 20 06:46:43 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e37aa0f0-3bfe-462c-ab9c-a36f7e4d7712 tempest-VolumesGetTest-1734161192 None] Lock "cinder-4f57af38-acb3-40be-a1d9-5f0f255fb9dc-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:43 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439.d66b83b9-3940-429f-8020-16d0dce2087a" returned: 0 in 0.637s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (fb98e927-541c-43bf-bd69-0c95fa27382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1154cb20-e58e-40ed-942e-1249056fd2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-d66b83b9-3940-429f-8020-16d0dce2087a" released by "_delete_snapshot" :: held 4.147s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" released by "delete_snapshot" :: held 4.213s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1154cb20-e58e-40ed-942e-1249056fd2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254581685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:44Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36009139-35ad-40fa-b9df-1b71b7bc3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36009139-35ad-40fa-b9df-1b71b7bc3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f429d96f-7a1b-43e2-a7d9-cdadd4a83455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:43 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:46:44 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Created reservations ['7edb30e6-7be1-40ce-851c-02ea8d995cc8', 'aea017e8-c8be-47fd-9b85-bb950f74e8f2', 'b1099fa5-eb33-43e9-8256-893ddbf84996', '5ff67fe4-9803-45f1-81d8-17c586733787'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Delete snapshot completed successfully. Aug 20 06:46:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27d350cf-5521-45f7-abe9-49e1bf4baae0 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-d66b83b9-3940-429f-8020-16d0dce2087a-delete_snapshot" released by "delete_snapshot" :: held 4.733s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f429d96f-7a1b-43e2-a7d9-cdadd4a83455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc', 'volume_name': 'volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49088cb1-5063-4bf7-81f2-26e8e61e9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49088cb1-5063-4bf7-81f2-26e8e61e9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0fba9-8e68-4081-be16-cb406e80f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:46:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Trying to clone 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "cinder-64d568b1-eecf-4e15-b1ab-1e1912021439-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-64d568b1-eecf-4e15-b1ab-1e1912021439-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" acquired by "delete_volume" :: waited 0.132s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:46:45 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9k_19245j.img" returned: 0 in 6.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6844d3ac-878f-42d2-9694-1755e0cfae58]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[11344e99-2b9b-4591-a4fd-45b0e8c648bb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:46:46 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Image download 20.69 MB at 20.69 MB/s Aug 20 06:46:46 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 Aug 20 06:46:46 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:46 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:46:46 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93882f-d49d-48aa-8a42-4e9bbe39dacc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:46 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD Aug 20 06:46:46 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:46 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439" returned: 0 in 0.425s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:46 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439 Aug 20 06:46:46 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:46 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.597s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9k_19245j.img {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:46:46 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Converted 1024.00 MB image at 160.91 MB/s Aug 20 06:46:46 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 is fetched for user 81dc8a9c6ba74198ab31e87e386f955f. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] 63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9 was raw, no need to convert to raw {{(pid=94234) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f39a3-0ea6-4009-b795-2f2cdc14a6ff]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:46 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-64d568b1-eecf-4e15-b1ab-1e1912021439" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-quobyte-64d568b1-eecf-4e15-b1ab-1e1912021439" released by "delete_volume" :: held 0.887s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Created reservations ['bbc2307d-bdd1-4aed-9e09-6fbed4644480', 'c9a4d545-6c61-40b2-bba3-dd61a55c009f', '3f9fe4c5-d373-40b4-883f-14ca35e5337d', 'ede2217b-5b93-423f-bac2-f158aec6ccf1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:46:46 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD Aug 20 06:46:46 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:46:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:46:46 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:46:46 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:46:47 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:46:47 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Aug 20 06:46:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:46:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:46:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Deleted volume successfully. Aug 20 06:46:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-2e2a013d-927a-45d8-933e-0cade3bc84d3 tempest-VolumesSnapshotNegativeTestJSON-1213844217 None] Lock "cinder-64d568b1-eecf-4e15-b1ab-1e1912021439-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:46:56 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=74,cinder:INSERT=22,cinder:UPDATE=93,cinder:DELETE=7 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:46:57 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=88,cinder:INSERT=30,cinder:UPDATE=94,cinder:DELETE=5 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.294s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Uploaded volume to glance image-id: 63c0b6f9-d6f0-4f62-b6aa-82e47f5bb0b9. {{(pid=94234) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.593s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254581685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:46:44Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Creating volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:12 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:12 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1073741824 Aug 20 06:47:12 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-69fbc151-5381-4136-ac48-aaeb3a78b183 tempest-VolumesActionsTest-19318111 None] Copy volume to image completed successfully. Aug 20 06:47:13 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1073741824" returned: 0 in 0.688s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:13 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc Aug 20 06:47:13 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:13 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" returned: 0 in 0.407s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Attempting download of d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0febd2b-0a70-4741-9814-98d2f629977a]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:14 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv Aug 20 06:47:14 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:14 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv" returned: 0 in 0.392s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb18901f-9011-46aa-afd0-45663b5b5541]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:14 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv Aug 20 06:47:14 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:14 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:47:14 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:14 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv" returned: 1 in 0.467s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_pnc7ppsv' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36294e0-534d-473f-83b9-377d0e9ca57d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:15 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.486s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bcc61-a629-4818-a324-3e8937533e8c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:15 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD Aug 20 06:47:15 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:15 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:47:15 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:15 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 was qcow2, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:15 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc Aug 20 06:47:15 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:15 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.642s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:15 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img Aug 20 06:47:15 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:19 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" returned: 0 in 4.272s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:19 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e38ba8-9dbb-43b8-a959-8267fa8b2d93_apio9p9jdevstack@QuobyteHD, size 112.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:47:19 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Converted 112.00 MB image at 26.19 MB/s Aug 20 06:47:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:19 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1G Aug 20 06:47:19 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:20 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc 1G" returned: 0 in 0.851s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Downloaded image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}])) to volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Temporary image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 for user 81dc8a9c6ba74198ab31e87e386f955f is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Marking volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Copying metadata from image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 to 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Creating volume glance metadata for volume 7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc backed by image d1e38ba8-9dbb-43b8-a959-8267fa8b2d93 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0fba9-8e68-4081-be16-cb406e80f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc', 'volume_size': 1, 'image_id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b6df46f7614a46887bdb772dd34f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1e38ba8-9dbb-43b8-a959-8267fa8b2d93', 'created_at': datetime.datetime(2026, 8, 20, 4, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e38ba8-9dbb-43b8-a959-8267fa8b2d93/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf46cc-19c8-4caa-833b-de88cb30f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Volume volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc (7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc): created successfully Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf46cc-19c8-4caa-833b-de88cb30f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (fb98e927-541c-43bf-bd69-0c95fa27382d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-41cb22a5-4d6b-47d6-ad8e-5637fad17e98 tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:47:22 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img" returned: 0 in 6.591s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:22 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd6bb6-a5eb-4122-9e0e-a2e279f51489]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:22 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:47:22 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:23 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.782s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:47:23 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Converted 1024.00 MB image at 155.34 MB/s Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] 15a78df2-b1b4-4b2e-9241-1a13c3778fa5 was raw, converting to qcow2 {{(pid=94234) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cda14-1cb7-4c82-90d7-b70aa6ae9e99]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (41c26ce5-04ff-40ae-8a9a-54e86639106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe08be8-e59a-49e1-8854-1d8ace2de4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:23 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img Aug 20 06:47:23 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe08be8-e59a-49e1-8854-1d8ace2de4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1946556301',display_name='tempest-VolumesGetTest-Volume-1611687633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb53b1-0f5c-415d-948f-c8b81a135f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:23Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ae64d-f675-4afd-a378-f95139b7a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ae64d-f675-4afd-a378-f95139b7a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2613d6f0-5438-47ba-853c-2e4349535237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2613d6f0-5438-47ba-853c-2e4349535237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bb53b1-0f5c-415d-948f-c8b81a135f01', 'volume_name': 'volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e4e08-7b41-4340-bf23-e9a09afaffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e4e08-7b41-4340-bf23-e9a09afaffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aee529-bfa2-4fb2-8c27-094245064653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Volume f4bb53b1-0f5c-415d-948f-c8b81a135f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01', 'volume_size': 1} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:23 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img" returned: 0 in 0.458s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:23 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img Aug 20 06:47:23 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:23 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img" returned: 1 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:47:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:23 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h Aug 20 06:47:23 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:24 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:24 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Image conversion details: src /opt/stack/data/cinder/conversion/9eccb7d6-fe9d-4fa5-90c3-12211c736635.temp_image.15a78df2-b1b4-4b2e-9241-1a13c3778fa56g9vyewr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:47:24 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 20 06:47:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f3cde-168c-4af8-a727-d8a5e9238b7c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:24 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h Aug 20 06:47:24 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:24 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3sn96f5h" returned: 0 in 0.416s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.083s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Uploaded volume to glance image-id: 15a78df2-b1b4-4b2e-9241-1a13c3778fa5. {{(pid=94234) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1946556301',display_name='tempest-VolumesGetTest-Volume-1611687633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb53b1-0f5c-415d-948f-c8b81a135f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4371abde87437b9f4fc82e4279ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:23Z,use_quota=True,user_id='81dc8a9c6ba74198ab31e87e386f955f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Creating volume f4bb53b1-0f5c-415d-948f-c8b81a135f01 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:26 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-67862474-1924-48f3-b5e2-5b4d1f5130cc tempest-VolumesActionsTest-19318111 None] Copy volume to image completed successfully. Aug 20 06:47:26 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 1073741824 Aug 20 06:47:26 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:27 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 1073741824" returned: 0 in 0.780s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:27 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 Aug 20 06:47:27 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:27 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01" returned: 0 in 0.496s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aee529-bfa2-4fb2-8c27-094245064653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaf8193-2536-4823-be66-dc64ee527100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Volume volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 (f4bb53b1-0f5c-415d-948f-c8b81a135f01): created successfully Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaf8193-2536-4823-be66-dc64ee527100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Flow 'volume_create_manager' (41c26ce5-04ff-40ae-8a9a-54e86639106e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6d224655-5c9f-435a-b0d6-42f7b3619d4c tempest-VolumesGetTest-1734161192 None] Created volume successfully. Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Flow 'volume_create_manager' (78151a7d-82db-4653-b000-999d9d1c4465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44aaf8b-9e64-4970-8ad2-8eddeb9c36b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44aaf8b-9e64-4970-8ad2-8eddeb9c36b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-429185219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33f12be-3d67-404a-9c8f-a29fc0a74415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37d64121e340649e624d1844a5ecf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:28Z,use_quota=True,user_id='87b9647ece3b448fa3abfa9666a53963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a88d2a-0c35-4d52-b582-94145e743ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a88d2a-0c35-4d52-b582-94145e743ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bb80c-8320-403e-815a-aa3b8c669377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bb80c-8320-403e-815a-aa3b8c669377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33f12be-3d67-404a-9c8f-a29fc0a74415', 'volume_name': 'volume-e33f12be-3d67-404a-9c8f-a29fc0a74415', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5fb82-9f87-4083-b54e-8deea753ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5fb82-9f87-4083-b54e-8deea753ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ab20bd-1094-4547-8047-c03e731385f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume e33f12be-3d67-404a-9c8f-a29fc0a74415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33f12be-3d67-404a-9c8f-a29fc0a74415', 'volume_size': 1} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-429185219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33f12be-3d67-404a-9c8f-a29fc0a74415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37d64121e340649e624d1844a5ecf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:28Z,use_quota=True,user_id='87b9647ece3b448fa3abfa9666a53963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Creating volume e33f12be-3d67-404a-9c8f-a29fc0a74415 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:28 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:28 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 1073741824 Aug 20 06:47:28 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Acquiring lock "cinder-quobyte-9eccb7d6-fe9d-4fa5-90c3-12211c736635" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:28 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Flow 'volume_create_manager' (b1324741-acff-46a8-b9f4-71c320113f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41beaa17-7127-4a17-a63c-9caf4a72af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "cinder-quobyte-9eccb7d6-fe9d-4fa5-90c3-12211c736635" acquired by "delete_volume" :: waited 0.105s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41beaa17-7127-4a17-a63c-9caf4a72af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-429096564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed86cfe0-3615-4af0-9982-a3a36ff5dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37d64121e340649e624d1844a5ecf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:29Z,use_quota=True,user_id='87b9647ece3b448fa3abfa9666a53963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b737e1c4-807a-4de3-9a5c-22e4659ec956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b737e1c4-807a-4de3-9a5c-22e4659ec956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe28c5ad-ff3c-43ad-8736-db57924a29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe28c5ad-ff3c-43ad-8736-db57924a29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed86cfe0-3615-4af0-9982-a3a36ff5dbe3', 'volume_name': 'volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c54756-0342-439e-906f-d0a19d88fd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c54756-0342-439e-906f-d0a19d88fd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ce9a80-4580-43ad-ab79-e27f24a05ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume ed86cfe0-3615-4af0-9982-a3a36ff5dbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3', 'volume_size': 1} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[269203e5-b03d-4f1e-9c65-231c11d04e90]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-f4bb53b1-0f5c-415d-948f-c8b81a135f01-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "cinder-f4bb53b1-0f5c-415d-948f-c8b81a135f01-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-f4bb53b1-0f5c-415d-948f-c8b81a135f01" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:29 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-f4bb53b1-0f5c-415d-948f-c8b81a135f01" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 1073741824" returned: 0 in 0.950s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab58f6d-d417-4c82-b78d-48800aab4e11]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:29 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:47:29 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:29 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 Aug 20 06:47:29 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:29 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 Aug 20 06:47:29 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:29 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415" returned: 0 in 0.331s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:29 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-429096564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed86cfe0-3615-4af0-9982-a3a36ff5dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37d64121e340649e624d1844a5ecf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:29Z,use_quota=True,user_id='87b9647ece3b448fa3abfa9666a53963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Creating volume ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:29 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.579s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ab20bd-1094-4547-8047-c03e731385f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33f12be-3d67-404a-9c8f-a29fc0a74415', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 1073741824 Aug 20 06:47:29 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baed07d8-19ca-495e-81a1-b5732d610c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:29 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635 Aug 20 06:47:29 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:29 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 (e33f12be-3d67-404a-9c8f-a29fc0a74415): created successfully Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baed07d8-19ca-495e-81a1-b5732d610c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Flow 'volume_create_manager' (78151a7d-82db-4653-b000-999d9d1c4465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f72991c9-7322-444e-87c5-ec3127a10f48 tempest-TestServerVolumeAttachmentScenario-992080548 None] Created volume successfully. Aug 20 06:47:30 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01" returned: 0 in 0.674s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:30 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01 Aug 20 06:47:30 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:30 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9eccb7d6-fe9d-4fa5-90c3-12211c736635" returned: 0 in 0.406s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "cinder-quobyte-9eccb7d6-fe9d-4fa5-90c3-12211c736635" released by "delete_volume" :: held 1.163s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Created reservations ['2b68eb6b-dca8-4722-88ec-863438a0bba7', '0c803090-d8a1-4452-bc91-fbe10c017e83', 'a6f39ff8-8dd1-46c9-ae6d-c511c2c1a39b', '294e4c78-89dd-478e-83b5-56d15dcaeaff'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:30 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f4bb53b1-0f5c-415d-948f-c8b81a135f01" returned: 0 in 0.418s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-f4bb53b1-0f5c-415d-948f-c8b81a135f01" released by "delete_volume" :: held 1.147s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:30 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:30 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:30 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 1073741824" returned: 0 in 0.796s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Created reservations ['3e046ec2-da88-4dbd-9c12-4556a83dc552', '7360a2c5-d084-44ba-9e5c-46606bc75421', '2a3150bb-ffa3-421e-aa8a-ed477895b170', 'de4c72fa-13f2-4a60-bc77-b0b18b838296'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:30 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 Aug 20 06:47:30 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:30 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:30 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:30 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.349s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Deleted volume successfully. Aug 20 06:47:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-354dff02-11e7-44ae-9392-5c32918540cc tempest-VolumesActionsTest-19318111 None] Lock "cinder-9eccb7d6-fe9d-4fa5-90c3-12211c736635-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:31 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" returned: 0 in 0.415s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ce9a80-4580-43ad-ab79-e27f24a05ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d573239-f184-4477-bdfe-f258dd83dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Volume volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 (ed86cfe0-3615-4af0-9982-a3a36ff5dbe3): created successfully Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d573239-f184-4477-bdfe-f258dd83dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Flow 'volume_create_manager' (b1324741-acff-46a8-b9f4-71c320113f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0cadc114-0bae-45e3-a967-eac02724e3a7 tempest-TestServerVolumeAttachmentScenario-992080548 None] Created volume successfully. Aug 20 06:47:31 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.440s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d6bce1f3-252f-4626-b2a4-978e8d99da78 tempest-VolumesGetTest-1734161192 None] Lock "cinder-f4bb53b1-0f5c-415d-948f-c8b81a135f01-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "cinder-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Acquiring lock "cinder-quobyte-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c970b4-32f6-4a39-b51f-3434221052a4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:31 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc Aug 20 06:47:31 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:32 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:32 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc Aug 20 06:47:32 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:32 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" returned: 0 in 0.328s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "cinder-quobyte-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc" released by "delete_volume" :: held 0.860s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Created reservations ['e1860ba3-c1ae-44a1-afdc-dc0a23198fd2', '43a11ce8-89fa-4ada-96f8-14e85363fbce', 'f153ae53-f30d-40e0-ad11-f2f9800f23c9', 'bc22af14-72fd-4788-b2ce-75f5bb05c32a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:32 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:32 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Flow 'volume_create_manager' (55b84f30-d75c-4287-88e5-314897241dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bca407-62b9-45b5-a7a1-27720e879650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bca407-62b9-45b5-a7a1-27720e879650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1907949137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2d486c-9215-44f8-af27-c67359fefe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04830919164eb786ab9a7977ff7a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:33Z,use_quota=True,user_id='e82d186f38914158b70f73cd41f270c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371dc35e-c068-4257-817e-b336d695ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371dc35e-c068-4257-817e-b336d695ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b194db-2e19-4242-96c9-17c11074a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b194db-2e19-4242-96c9-17c11074a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2d486c-9215-44f8-af27-c67359fefe2a', 'volume_name': 'volume-da2d486c-9215-44f8-af27-c67359fefe2a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a80715-11d3-4dc6-b6ac-15ce855980ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a80715-11d3-4dc6-b6ac-15ce855980ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69952862-6726-4720-b8e1-c6cf951a144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:33 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Volume da2d486c-9215-44f8-af27-c67359fefe2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2d486c-9215-44f8-af27-c67359fefe2a', 'volume_size': 1} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1907949137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2d486c-9215-44f8-af27-c67359fefe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04830919164eb786ab9a7977ff7a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:33Z,use_quota=True,user_id='e82d186f38914158b70f73cd41f270c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Creating volume da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:33 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:33 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.430s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Deleted volume successfully. Aug 20 06:47:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-82d3a564-1273-483e-a14c-472c957ee16e tempest-VolumesGetTest-1734161192 None] Lock "cinder-7dfce806-3b1e-4fd7-8fe3-f15492cfdbfc-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:33 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a 1073741824 Aug 20 06:47:33 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:34 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a 1073741824" returned: 0 in 0.805s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:34 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:47:34 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:34 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69952862-6726-4720-b8e1-c6cf951a144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2d486c-9215-44f8-af27-c67359fefe2a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:34 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:34 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01170c6-74af-4b4d-8fbe-7e8b622cba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:34 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Volume volume-da2d486c-9215-44f8-af27-c67359fefe2a (da2d486c-9215-44f8-af27-c67359fefe2a): created successfully Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01170c6-74af-4b4d-8fbe-7e8b622cba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Flow 'volume_create_manager' (55b84f30-d75c-4287-88e5-314897241dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a60158e5-b10a-42b0-aade-4af388db4ca6 tempest-TestStampPattern-1013928246 None] Created volume successfully. Aug 20 06:47:34 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:47:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (25ceee74-d567-4919-a08e-bbc2341c1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355b106-15ae-4ee0-80e2-764ad9cc69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355b106-15ae-4ee0-80e2-764ad9cc69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1936733185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de635bc-20e9-410c-b09b-21e603708ab3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:38Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103fc85b-4bf5-46bf-8228-6b6a6d9e9647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103fc85b-4bf5-46bf-8228-6b6a6d9e9647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d478ecd2-cdbd-46c9-b115-bd02524879e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d478ecd2-cdbd-46c9-b115-bd02524879e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de635bc-20e9-410c-b09b-21e603708ab3', 'volume_name': 'volume-9de635bc-20e9-410c-b09b-21e603708ab3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83894d5d-db1b-426e-9dc6-8f7aa72a50a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83894d5d-db1b-426e-9dc6-8f7aa72a50a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fb8c63-67f3-4188-8c12-bff974e7bf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Volume 9de635bc-20e9-410c-b09b-21e603708ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de635bc-20e9-410c-b09b-21e603708ab3', 'volume_size': 1} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1936733185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de635bc-20e9-410c-b09b-21e603708ab3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:38Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Creating volume 9de635bc-20e9-410c-b09b-21e603708ab3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:38 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:38 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 1073741824 Aug 20 06:47:38 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:38 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 1073741824" returned: 0 in 0.573s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:38 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 Aug 20 06:47:38 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:39 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fb8c63-67f3-4188-8c12-bff974e7bf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de635bc-20e9-410c-b09b-21e603708ab3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f40802-4869-4626-b87f-12c6a8ceac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Volume volume-9de635bc-20e9-410c-b09b-21e603708ab3 (9de635bc-20e9-410c-b09b-21e603708ab3): created successfully Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f40802-4869-4626-b87f-12c6a8ceac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (25ceee74-d567-4919-a08e-bbc2341c1666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bd8f7df4-f259-4122-b04e-d1d156d4696e tempest-VolumesListTestJSON-1017224763 None] Created volume successfully. Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (6f50dcb1-0cc1-49f2-a236-64f724d2d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a635a9ea-da1a-4e07-b6f9-1cd44b8909cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a635a9ea-da1a-4e07-b6f9-1cd44b8909cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1057055813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4aec1d2-e04e-455f-b040-8edfa8636ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:41Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aea22b9-ed33-4192-a0f2-66111f3be92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aea22b9-ed33-4192-a0f2-66111f3be92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3c9ab-e2f4-404f-a40b-2ea4d52310d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3c9ab-e2f4-404f-a40b-2ea4d52310d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4aec1d2-e04e-455f-b040-8edfa8636ebd', 'volume_name': 'volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94711183-42aa-4ca1-a5af-4e5841d8de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94711183-42aa-4ca1-a5af-4e5841d8de2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d523a5f7-e3ee-4296-8e84-b1b83c43c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Volume e4aec1d2-e04e-455f-b040-8edfa8636ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd', 'volume_size': 1} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1057055813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4aec1d2-e04e-455f-b040-8edfa8636ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:41Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Creating volume e4aec1d2-e04e-455f-b040-8edfa8636ebd {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:41 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:41 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd 1073741824 Aug 20 06:47:41 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:42 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd 1073741824" returned: 0 in 0.829s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:42 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd Aug 20 06:47:42 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:43 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd" returned: 0 in 0.684s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d523a5f7-e3ee-4296-8e84-b1b83c43c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27b7859-9639-4b6e-8b04-f42512fab07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Volume volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd (e4aec1d2-e04e-455f-b040-8edfa8636ebd): created successfully Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27b7859-9639-4b6e-8b04-f42512fab07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (6f50dcb1-0cc1-49f2-a236-64f724d2d104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Flow 'volume_create_manager' (d85bc822-c71f-4e89-a9b7-730898508f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb95c1c7-54dd-4f2e-b398-120b076640a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6c9940df-298e-4ca6-a83f-af08ddbd3b76 tempest-VolumesListTestJSON-1017224763 None] Created volume successfully. Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb95c1c7-54dd-4f2e-b398-120b076640a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-165114155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0140e525-7201-4ef0-9f32-5db072b3a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18227cd2eeaf4562a5ef9d443b66f227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:43Z,use_quota=True,user_id='3c292a3a6b964380849d34baf7086026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79084dd9-09a8-42a9-a270-c920c730ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79084dd9-09a8-42a9-a270-c920c730ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554c2b6-95b2-4aff-b2c1-e5971dd30587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554c2b6-95b2-4aff-b2c1-e5971dd30587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0140e525-7201-4ef0-9f32-5db072b3a035', 'volume_name': 'volume-0140e525-7201-4ef0-9f32-5db072b3a035', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9770be2-1b3c-44d7-98a1-d432210407bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9770be2-1b3c-44d7-98a1-d432210407bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940231e-182c-4bce-8508-3a9b42e29caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Volume 0140e525-7201-4ef0-9f32-5db072b3a035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0140e525-7201-4ef0-9f32-5db072b3a035', 'volume_size': 1} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-165114155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0140e525-7201-4ef0-9f32-5db072b3a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18227cd2eeaf4562a5ef9d443b66f227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:43Z,use_quota=True,user_id='3c292a3a6b964380849d34baf7086026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Creating volume 0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:43 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:43 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 1073741824 Aug 20 06:47:43 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:44 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 1073741824" returned: 0 in 1.551s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:45 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:47:45 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (98820008-13bf-412b-8e1d-3bc6573604be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476874a-dc4b-4498-b709-86fac011d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476874a-dc4b-4498-b709-86fac011d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1747502090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:45Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc620260-fd3e-4692-9d95-343e09a45fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc620260-fd3e-4692-9d95-343e09a45fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb21973a-3d9c-433b-98a1-56c3858ce35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb21973a-3d9c-433b-98a1-56c3858ce35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93', 'volume_name': 'volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3054f4cb-c3b5-412f-9041-861320c2ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3054f4cb-c3b5-412f-9041-861320c2ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c755ca-b02d-4b9e-aaef-7e9f1c3155c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Volume 6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93', 'volume_size': 1} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:45 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1747502090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c83e73901b94b909f9393cd19e58a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:45Z,use_quota=True,user_id='a7dd974d10e7414687e828a390013646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Creating volume 6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:47:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940231e-182c-4bce-8508-3a9b42e29caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0140e525-7201-4ef0-9f32-5db072b3a035', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 1073741824 Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defdd4c0-11bd-471b-b7ae-7f8378e5e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:45 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Volume volume-0140e525-7201-4ef0-9f32-5db072b3a035 (0140e525-7201-4ef0-9f32-5db072b3a035): created successfully Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defdd4c0-11bd-471b-b7ae-7f8378e5e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Flow 'volume_create_manager' (d85bc822-c71f-4e89-a9b7-730898508f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a0344c47-f69e-4d0d-bfdb-ab70b6ad739b tempest-VolumesCloneTest-2053126892 None] Created volume successfully. Aug 20 06:47:46 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 1073741824" returned: 0 in 0.732s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:46 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 Aug 20 06:47:46 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:46 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" returned: 0 in 0.443s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c755ca-b02d-4b9e-aaef-7e9f1c3155c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e94d1de-2a6f-4094-9f8e-4853d87ecf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Volume volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 (6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93): created successfully Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e94d1de-2a6f-4094-9f8e-4853d87ecf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Flow 'volume_create_manager' (98820008-13bf-412b-8e1d-3bc6573604be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bdaf5452-156e-41f6-b008-264d9df6074a tempest-VolumesListTestJSON-1017224763 None] Created volume successfully. Aug 20 06:47:47 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Flow 'volume_create_manager' (f5fb8d0b-ec1e-4c0e-bd46-6a167e7f86e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233262a6-462f-4e09-8fb5-e1388ff248b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233262a6-462f-4e09-8fb5-e1388ff248b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-427492383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f552f174-22dd-433d-af9a-4eec5b2f0668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18227cd2eeaf4562a5ef9d443b66f227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:47:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0140e525-7201-4ef0-9f32-5db072b3a035,status='creating',terminated_at=None,updated_at=2026-08-20T04:47:48Z,use_quota=True,user_id='3c292a3a6b964380849d34baf7086026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47aef4b-07c7-4b6f-a174-b0b66a06bdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47aef4b-07c7-4b6f-a174-b0b66a06bdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952d2bc2-f761-4f5f-95d8-4624b9c39507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952d2bc2-f761-4f5f-95d8-4624b9c39507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f552f174-22dd-433d-af9a-4eec5b2f0668', 'volume_name': 'volume-f552f174-22dd-433d-af9a-4eec5b2f0668', 'volume_size': 2, 'source_volid': '0140e525-7201-4ef0-9f32-5db072b3a035', 'source_volstatus': 'available'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa96b0e4-0151-4c7f-922a-e2183fa8508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa96b0e4-0151-4c7f-922a-e2183fa8508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb6859d-e97f-42c3-9ba2-1cb88d13b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:47:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Volume f552f174-22dd-433d-af9a-4eec5b2f0668: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f552f174-22dd-433d-af9a-4eec5b2f0668', 'volume_size': 2, 'source_volid': '0140e525-7201-4ef0-9f32-5db072b3a035', 'source_volstatus': 'available'} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:48 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Cloning volume 0140e525-7201-4ef0-9f32-5db072b3a035 to volume f552f174-22dd-433d-af9a-4eec5b2f0668 Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Creating offline snapshot d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 of volume 0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b76c1b-159f-4854-bd77-4bf4563ac1fa]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:48 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:47:48 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:49 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.933s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:49 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 1G Aug 20 06:47:49 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:50 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 1G" returned: 0 in 1.082s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0140e525-7201-4ef0-9f32-5db072b3a035 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:50 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0140e525-7201-4ef0-9f32-5db072b3a035 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:47:50 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:51 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0140e525-7201-4ef0-9f32-5db072b3a035 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.792s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:51 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 is being set with open permissions: ugo+rw Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:51 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:47:51 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-quobyte-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8e074-6607-4c47-9b48-4a08a7a82566]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:52 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.830s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:52 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 Aug 20 06:47:52 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:52 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info Aug 20 06:47:52 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:52 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" returned: 0 in 0.879s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:52 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info" returned: 0 in 0.614s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:52 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info is being set with open permissions: ugo+rw Aug 20 06:47:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:52 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info Aug 20 06:47:52 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:52 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93 Aug 20 06:47:52 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:53 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93" released by "delete_volume" :: held 1.559s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:53 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.info" returned: 0 in 0.656s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] snapshot: d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9, volume: f552f174-22dd-433d-af9a-4eec5b2f0668, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0924f4-8d17-4bb1-92e4-f64a67c3b829]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Created reservations ['f401d3b8-a767-4f7f-be8e-8c69166a6781', '647cb7c5-381e-48dd-a11f-03087df568cf', '6df6e710-7423-4ed2-bdb3-e3cfdd1e95b0', 'd942a8a8-eaf7-4f68-a70c-f5919323a509'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:53 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:47:53 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:53 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:53 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-e4aec1d2-e04e-455f-b040-8edfa8636ebd-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:54 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.417s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-e4aec1d2-e04e-455f-b040-8edfa8636ebd-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Deleted volume successfully. Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-79e8ad99-2a09-4a43-9601-3648a6f74faf tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-6f5ae5c1-ce3c-4e47-8a20-bf5a9fe4bb93-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-quobyte-e4aec1d2-e04e-455f-b040-8edfa8636ebd" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-e4aec1d2-e04e-455f-b040-8edfa8636ebd" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6157262f-be40-4740-9f3d-cac5e317eca7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:54 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.808s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0140e525-7201-4ef0-9f32-5db072b3a035(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[126a0b2f-3bd6-4585-8bf0-f1379a03dff7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:54 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd Aug 20 06:47:54 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:54 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:47:54 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:55 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.622s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:55 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 Aug 20 06:47:55 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:55 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd" returned: 0 in 0.833s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:55 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd Aug 20 06:47:55 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:55 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e4aec1d2-e04e-455f-b040-8edfa8636ebd" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-e4aec1d2-e04e-455f-b040-8edfa8636ebd" released by "delete_volume" :: held 1.446s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:55 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Created reservations ['118f72fa-bb3f-44a6-afaf-49eee321a223', 'e0d4d701-3266-41a9-89ec-f2aa083bef2d', 'eaecec19-6fcf-41a9-a79f-fa60bdc048a6', 'cfb7759c-381b-4c30-b5d6-b5ddcf21ac9b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:47:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:56 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:47:56 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-9de635bc-20e9-410c-b09b-21e603708ab3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-9de635bc-20e9-410c-b09b-21e603708ab3-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "cinder-quobyte-9de635bc-20e9-410c-b09b-21e603708ab3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-9de635bc-20e9-410c-b09b-21e603708ab3" acquired by "delete_volume" :: waited 0.111s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699c9cc-a046-4f99-8d7a-b1118d730952]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:47:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:57 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 1.761s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:58 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:47:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Deleted volume successfully. Aug 20 06:47:58 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 Aug 20 06:47:58 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4bd3000d-0df9-4c34-b106-2359fc98be66 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-e4aec1d2-e04e-455f-b040-8edfa8636ebd-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:47:58 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3" returned: 0 in 0.904s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:47:59 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3 Aug 20 06:47:59 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:47:59 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Aug 20 06:47:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9de635bc-20e9-410c-b09b-21e603708ab3" returned: 0 in 0.967s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:47:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-quobyte-9de635bc-20e9-410c-b09b-21e603708ab3" released by "delete_volume" :: held 2.089s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Created reservations ['fa9a4531-f58e-4fea-9da9-9ea5b4e1782b', 'd65a3151-54e3-4378-904f-1b38154b80a9', 'f82e01a4-f7cb-4e26-b302-b640e2b7062e', '4bd113a6-19d3-4518-acc7-f650dc552eb4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:00 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:00 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:01 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.919s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:01 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Deleted volume successfully. Aug 20 06:48:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9fccbe56-9c3f-47b2-8527-907f23396504 tempest-VolumesListTestJSON-1017224763 None] Lock "cinder-9de635bc-20e9-410c-b09b-21e603708ab3-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:03 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668" returned: 0 in 7.881s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:48:03 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Converted 1024.00 MB image at 129.91 MB/s Aug 20 06:48:03 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 is being set with open permissions: ugo+rw Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:03 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 Aug 20 06:48:03 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:03 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" released by "_copy_volume_from_snapshot" :: held 9.693s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-quobyte-d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Deleting offline snapshot d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 of volume 0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] snapshot_file for this snap is: volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c4edd-0250-4531-af57-ab33155cb108]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:03 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:48:03 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:03 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.375s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0140e525-7201-4ef0-9f32-5db072b3a035(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1da23-6e92-446a-b41d-7afca3b5205f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:03 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:48:03 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:04 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.561s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:04 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:48:04 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:04 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:04 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9 Aug 20 06:48:04 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:04 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035.d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-d8a58f20-a6e5-4d3a-9f5f-53ea5c9acfb9" released by "_delete_snapshot" :: held 1.695s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.716s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb6859d-e97f-42c3-9ba2-1cb88d13b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f552f174-22dd-433d-af9a-4eec5b2f0668', 'volume_size': 2, 'source_volid': '0140e525-7201-4ef0-9f32-5db072b3a035', 'source_volstatus': 'available'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7386c099-df62-4697-bb2f-f50bc90d7724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:05 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Volume volume-f552f174-22dd-433d-af9a-4eec5b2f0668 (f552f174-22dd-433d-af9a-4eec5b2f0668): created successfully Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7386c099-df62-4697-bb2f-f50bc90d7724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Flow 'volume_create_manager' (f5fb8d0b-ec1e-4c0e-bd46-6a167e7f86e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-80b5678c-bec1-4684-a04b-041c9e6033ee tempest-VolumesCloneTest-2053126892 None] Created volume successfully. Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-f552f174-22dd-433d-af9a-4eec5b2f0668-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "cinder-f552f174-22dd-433d-af9a-4eec5b2f0668-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[20299ccb-0aff-4107-892f-fb48023bfda1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:06 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 Aug 20 06:48:06 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:06 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668" returned: 0 in 0.444s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:06 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668 Aug 20 06:48:06 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:06 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f552f174-22dd-433d-af9a-4eec5b2f0668" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-f552f174-22dd-433d-af9a-4eec5b2f0668" released by "delete_volume" :: held 0.814s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Created reservations ['cbffc4b1-8977-4bc4-a57f-11aecd45f16a', '293e3e06-45d2-4737-8730-9dbf1d0da714', '38a98ded-8c1c-4bd4-9ff9-9d2655b92fe8', 'de1e229b-e027-4ec4-908a-ed26201f5d9a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:06 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:06 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-0140e525-7201-4ef0-9f32-5db072b3a035-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:07 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "cinder-0140e525-7201-4ef0-9f32-5db072b3a035-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Deleted volume successfully. Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=91,cinder:INSERT=25,cinder:SELECT=70,cinder:DELETE=10 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-961c1095-8251-4d21-a7b1-f0ff71c29eda tempest-VolumesCloneTest-2053126892 None] Lock "cinder-f552f174-22dd-433d-af9a-4eec5b2f0668-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Acquiring lock "cinder-quobyte-0140e525-7201-4ef0-9f32-5db072b3a035" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-0140e525-7201-4ef0-9f32-5db072b3a035" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ddb1a3-fea8-4cc4-a16a-3b449c21d864]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:07 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:48:07 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:07 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:07 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035 Aug 20 06:48:07 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:08 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0140e525-7201-4ef0-9f32-5db072b3a035" returned: 0 in 0.318s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "cinder-quobyte-0140e525-7201-4ef0-9f32-5db072b3a035" released by "delete_volume" :: held 0.866s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=66,cinder:UPDATE=90,cinder:INSERT=27,cinder:DELETE=7 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Created reservations ['6bce51e8-8dd6-47bc-8283-a5b4fbc73145', '59e6001c-b4bd-4ff6-b476-690d2a240e95', '99da7a31-3009-4454-974b-52c4c6e1406d', 'c5866f3d-a7c2-4dab-9adf-5a0c939301a3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:08 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:08 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:08 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.484s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Deleted volume successfully. Aug 20 06:48:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-19ae0cdb-f8dd-45b3-a962-3c87442c82c3 tempest-VolumesCloneTest-2053126892 None] Lock "cinder-0140e525-7201-4ef0-9f32-5db072b3a035-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-323762c6-43fe-43bc-ad9d-0f3ae744a19d req-3ee18d43-0a9a-44cb-b552-343918d7d951 tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-323762c6-43fe-43bc-ad9d-0f3ae744a19d req-3ee18d43-0a9a-44cb-b552-343918d7d951 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-323762c6-43fe-43bc-ad9d-0f3ae744a19d req-3ee18d43-0a9a-44cb-b552-343918d7d951 tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-323762c6-43fe-43bc-ad9d-0f3ae744a19d req-3ee18d43-0a9a-44cb-b552-343918d7d951 tempest-TestServerVolumeAttachmentScenario-992080548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-e33f12be-3d67-404a-9c8f-a29fc0a74415', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c55aa13e-c610-4fd5-8713-2cd028d8afe3', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:48:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-323762c6-43fe-43bc-ad9d-0f3ae744a19d req-3ee18d43-0a9a-44cb-b552-343918d7d951 tempest-TestServerVolumeAttachmentScenario-992080548 None] attachment_update completed successfully. Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Flow 'volume_create_manager' (9c815d34-90bc-4002-af1d-a405a4104872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f7bf68-69a1-40ed-9252-7a6310c44b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f7bf68-69a1-40ed-9252-7a6310c44b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2013305266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cce3b6-d412-4f2b-b3aa-b5a4d8013904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e2f5b4515841a6a7bade5b8363e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:48:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:48:13Z,use_quota=True,user_id='99132f3574e1446fbfdcca251dd93c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70cf314-ca54-4825-b6cd-7a1aa6e494de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70cf314-ca54-4825-b6cd-7a1aa6e494de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6282a933-2096-4dbd-96b7-97d37c044d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6282a933-2096-4dbd-96b7-97d37c044d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86cce3b6-d412-4f2b-b3aa-b5a4d8013904', 'volume_name': 'volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904', 'volume_size': 2}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da457a-dc72-4ba1-997b-7903a7893fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da457a-dc72-4ba1-997b-7903a7893fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2520e6-12aa-452e-9cde-5efeeb35f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:12 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Volume 86cce3b6-d412-4f2b-b3aa-b5a4d8013904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904', 'volume_size': 2} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2013305266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cce3b6-d412-4f2b-b3aa-b5a4d8013904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e2f5b4515841a6a7bade5b8363e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:48:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:48:13Z,use_quota=True,user_id='99132f3574e1446fbfdcca251dd93c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Creating volume 86cce3b6-d412-4f2b-b3aa-b5a4d8013904 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:48:12 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:48:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 2147483648 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:12 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 2147483648 Aug 20 06:48:12 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:13 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 2147483648" returned: 0 in 0.604s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:13 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 Aug 20 06:48:13 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:13 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2520e6-12aa-452e-9cde-5efeeb35f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904', 'volume_size': 2}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94d6bd8-aff1-4f57-a2f8-3dde4df66cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Volume volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 (86cce3b6-d412-4f2b-b3aa-b5a4d8013904): created successfully Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94d6bd8-aff1-4f57-a2f8-3dde4df66cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Flow 'volume_create_manager' (9c815d34-90bc-4002-af1d-a405a4104872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-17ab4491-a1ba-4186-97a1-3b7b906ca605 tempest-VolumesCloneNegativeTest-1209290929 None] Created volume successfully. Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Acquiring lock "cinder-86cce3b6-d412-4f2b-b3aa-b5a4d8013904-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "cinder-86cce3b6-d412-4f2b-b3aa-b5a4d8013904-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Acquiring lock "cinder-quobyte-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "cinder-quobyte-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acc47f-4dac-4f9c-af02-970a68df4386]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:15 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 Aug 20 06:48:15 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:15 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" returned: 0 in 0.477s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:15 devstack sudo[109856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904 Aug 20 06:48:15 devstack sudo[109856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:16 devstack sudo[109856]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" returned: 0 in 0.418s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "cinder-quobyte-86cce3b6-d412-4f2b-b3aa-b5a4d8013904" released by "delete_volume" :: held 0.973s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Created reservations ['b39df4c6-f6c6-4f52-a5c8-9a3a025efcdf', 'a479e623-8df8-4cd0-b1c2-9a068307514e', '676c649a-3de4-4e08-8c8e-1be00cbccac0', 'f4b117e1-87c7-45e4-9f80-4c4fe87dd93b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:16 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:16 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-30221dfe-91de-4dbf-b34f-04f4d1b6eee1 req-c63cc17f-e54e-480a-a0cf-c0f4e616df77 tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-30221dfe-91de-4dbf-b34f-04f4d1b6eee1 req-c63cc17f-e54e-480a-a0cf-c0f4e616df77 tempest-TestStampPattern-1013928246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-30221dfe-91de-4dbf-b34f-04f4d1b6eee1 req-c63cc17f-e54e-480a-a0cf-c0f4e616df77 tempest-TestStampPattern-1013928246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-895aa719-3306-4f19-83d5-300b5f0137fa req-b8a927f3-cae0-40c5-98a1-988b941d511e tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-895aa719-3306-4f19-83d5-300b5f0137fa req-b8a927f3-cae0-40c5-98a1-988b941d511e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-895aa719-3306-4f19-83d5-300b5f0137fa req-b8a927f3-cae0-40c5-98a1-988b941d511e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-30221dfe-91de-4dbf-b34f-04f4d1b6eee1 req-c63cc17f-e54e-480a-a0cf-c0f4e616df77 tempest-TestStampPattern-1013928246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-da2d486c-9215-44f8-af27-c67359fefe2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c3d1f04-d9ea-4889-ae8a-3abaa736dc3b', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-895aa719-3306-4f19-83d5-300b5f0137fa req-b8a927f3-cae0-40c5-98a1-988b941d511e tempest-TestServerVolumeAttachmentScenario-992080548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '117deabd-bd83-4bba-8439-3b6d303a4bb5', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:48:16 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.360s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:16 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Deleted volume successfully. Aug 20 06:48:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-30221dfe-91de-4dbf-b34f-04f4d1b6eee1 req-c63cc17f-e54e-480a-a0cf-c0f4e616df77 tempest-TestStampPattern-1013928246 None] attachment_update completed successfully. Aug 20 06:48:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-895aa719-3306-4f19-83d5-300b5f0137fa req-b8a927f3-cae0-40c5-98a1-988b941d511e tempest-TestServerVolumeAttachmentScenario-992080548 None] attachment_update completed successfully. Aug 20 06:48:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-993587a1-94c9-49b2-8505-31f894285eaf tempest-VolumesCloneNegativeTest-1209290929 None] Lock "cinder-86cce3b6-d412-4f2b-b3aa-b5a4d8013904-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-2c7be440-c7f7-4636-9803-d97d6c1d3f9e req-bd5fd286-0574-4f59-bc0f-1b72fd35199e tempest-TestServerVolumeAttachmentScenario-992080548 None] Terminate volume connection completed successfully. Aug 20 06:48:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-2c7be440-c7f7-4636-9803-d97d6c1d3f9e req-bd5fd286-0574-4f59-bc0f-1b72fd35199e tempest-TestServerVolumeAttachmentScenario-992080548 None] Deleting attachment 117deabd-bd83-4bba-8439-3b6d303a4bb5. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:48:21 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-f8e04144-b63f-40fe-b058-39c2abf2157a req-4818d0b7-23b3-4b50-a380-3528d7cc87fe tempest-TestServerVolumeAttachmentScenario-992080548 None] Terminate volume connection completed successfully. Aug 20 06:48:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-f8e04144-b63f-40fe-b058-39c2abf2157a req-4818d0b7-23b3-4b50-a380-3528d7cc87fe tempest-TestServerVolumeAttachmentScenario-992080548 None] Deleting attachment c55aa13e-c610-4fd5-8713-2cd028d8afe3. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:48:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-bd9d5ef3-dadc-4739-a8bb-b07988e7ed93 req-69dbff7c-3667-4ff8-a07a-4e6de21f3ae4 tempest-TestStampPattern-1013928246 None] Terminate volume connection completed successfully. Aug 20 06:48:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-bd9d5ef3-dadc-4739-a8bb-b07988e7ed93 req-69dbff7c-3667-4ff8-a07a-4e6de21f3ae4 tempest-TestStampPattern-1013928246 None] Deleting attachment 8c3d1f04-d9ea-4889-ae8a-3abaa736dc3b. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Creating offline snapshot 6caa0b28-3c2f-4114-aa45-c52437bcbf2a of volume da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b12ee-9095-4598-9ec4-f6181424cf6d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:25 devstack sudo[109976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:48:25 devstack sudo[109976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:25 devstack sudo[109976]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:25 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a 1G Aug 20 06:48:25 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:26 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a 1G" returned: 0 in 0.565s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2d486c-9215-44f8-af27-c67359fefe2a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:26 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2d486c-9215-44f8-af27-c67359fefe2a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:48:26 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:26 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2d486c-9215-44f8-af27-c67359fefe2a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.354s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:26 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a is being set with open permissions: ugo+rw Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:26 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:48:26 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:26 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:26 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info Aug 20 06:48:26 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:27 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:27 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info is being set with open permissions: ugo+rw Aug 20 06:48:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:27 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info Aug 20 06:48:27 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:27 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.info" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:27 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-55fcf874-c3d0-4063-b10a-19446a5cc3aa tempest-TestStampPattern-1013928246 None] Create snapshot completed successfully Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:34 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:34 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:34 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.454s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:48:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:48:37 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=42,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:48:37 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:INSERT=5,cinder:UPDATE=27,cinder:SELECT=31,cinder:DELETE=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Flow 'volume_create_manager' (31ea88d5-8239-4b1e-8935-190929172e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d31eb0a-3b77-4c5f-a743-883fa322a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d31eb0a-3b77-4c5f-a743-883fa322a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1334901964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4d9ba1-263d-415e-b3e0-3a56dec659ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04830919164eb786ab9a7977ff7a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6caa0b28-3c2f-4114-aa45-c52437bcbf2a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:48:38Z,use_quota=True,user_id='e82d186f38914158b70f73cd41f270c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b226940-6f81-4e13-a92b-bb483e11e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b226940-6f81-4e13-a92b-bb483e11e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27b941-9480-4d89-8d8a-be1a7b8ba25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27b941-9480-4d89-8d8a-be1a7b8ba25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee4d9ba1-263d-415e-b3e0-3a56dec659ec', 'volume_name': 'volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec', 'volume_size': 1, 'snapshot_id': '6caa0b28-3c2f-4114-aa45-c52437bcbf2a'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073d6014-259e-44f1-ade8-a0b690b350b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073d6014-259e-44f1-ade8-a0b690b350b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ea3834-74bf-4fc9-92ea-a5fb373e71c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Volume ee4d9ba1-263d-415e-b3e0-3a56dec659ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec', 'volume_size': 1, 'snapshot_id': '6caa0b28-3c2f-4114-aa45-c52437bcbf2a'} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Creating volume ee4d9ba1-263d-415e-b3e0-3a56dec659ec from snapshot 6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] snapshot: 6caa0b28-3c2f-4114-aa45-c52437bcbf2a, volume: ee4d9ba1-263d-415e-b3e0-3a56dec659ec, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457a4ad-ce97-4768-9969-d925a21693ab]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:38 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:48:38 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:38 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.515s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da2d486c-9215-44f8-af27-c67359fefe2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee990e04-2ef0-420a-8ee4-2f9cdddc4600]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:48:39 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:48:39 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Flow 'volume_create_manager' (a3be24e0-1e92-4b19-8069-7f798b7298c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f92c87-6a4a-4bb6-bf36-cf4c0c009f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f92c87-6a4a-4bb6-bf36-cf4c0c009f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-577651470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83238a27-0f42-47a8-be8e-0db30f36620b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3132a14ae419fba60f063e4ea5d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:48:39Z,use_quota=True,user_id='2c3f88ad24be45f2b263d78a7b67d83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d582b603-0960-4a0b-a285-5bdcb42cde5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d582b603-0960-4a0b-a285-5bdcb42cde5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7fbf09-b71b-422f-a229-bab01f4471a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7fbf09-b71b-422f-a229-bab01f4471a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83238a27-0f42-47a8-be8e-0db30f36620b', 'volume_name': 'volume-83238a27-0f42-47a8-be8e-0db30f36620b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5488ea-36c1-4cfc-8ff0-24ba683bd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5488ea-36c1-4cfc-8ff0-24ba683bd29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa198b8c-a7d0-4fd5-9b76-f1432b216326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Volume 83238a27-0f42-47a8-be8e-0db30f36620b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83238a27-0f42-47a8-be8e-0db30f36620b', 'volume_size': 1} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "cinder-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "cinder-quobyte-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-quobyte-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" acquired by "delete_volume" :: waited 0.037s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c2806-19ee-498e-9f56-73de9752b770]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:39 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.591s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:39 devstack sudo[110052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec Aug 20 06:48:39 devstack sudo[110052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:39 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 Aug 20 06:48:39 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:39 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" returned: 0 in 0.523s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:39 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3 Aug 20 06:48:39 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:40 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" returned: 0 in 0.461s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-quobyte-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3" released by "delete_volume" :: held 1.104s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:40 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Created reservations ['9cc02874-22fc-46e3-8c3b-e7c38d6dc359', 'dbabd779-5477-40ea-9631-efe05f6404f4', '662b8b14-9193-48e6-87bd-6f4f323229b6', 'b8d52504-dd32-49af-af40-fe77d6566739'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:41 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:41 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:41 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.765s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:41 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Deleted volume successfully. Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a44292e-0f00-47ec-af60-10dfa41d126a tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-ed86cfe0-3615-4af0-9982-a3a36ff5dbe3-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "cinder-e33f12be-3d67-404a-9c8f-a29fc0a74415-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-e33f12be-3d67-404a-9c8f-a29fc0a74415-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "cinder-quobyte-e33f12be-3d67-404a-9c8f-a29fc0a74415" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-quobyte-e33f12be-3d67-404a-9c8f-a29fc0a74415" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e45202-45e2-41a3-904d-fa75003550a3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:42 devstack sudo[110076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 Aug 20 06:48:42 devstack sudo[110076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:43 devstack sudo[110076]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415" returned: 0 in 0.795s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:43 devstack sudo[110084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415 Aug 20 06:48:43 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:44 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e33f12be-3d67-404a-9c8f-a29fc0a74415" returned: 0 in 0.871s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-quobyte-e33f12be-3d67-404a-9c8f-a29fc0a74415" released by "delete_volume" :: held 1.840s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Created reservations ['724f43fc-e518-423a-b092-112ecc2a55d4', '80093a01-f2ab-479a-916c-bf60c722192e', '57bbc85d-e77d-44f0-b86a-0f669ca42ad0', 'cf7a91c9-3f1b-49fa-ab10-a8cceec88dbc'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:44 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:48:44 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:45 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.710s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:45 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:48:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Deleted volume successfully. Aug 20 06:48:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5598f4ec-7996-45a2-a708-006e37f1ed6e tempest-TestServerVolumeAttachmentScenario-992080548 None] Lock "cinder-e33f12be-3d67-404a-9c8f-a29fc0a74415-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:46 devstack sudo[110052]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" returned: 0 in 6.979s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:48:46 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Converted 1024.00 MB image at 146.71 MB/s Aug 20 06:48:46 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec is being set with open permissions: ugo+rw Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:46 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec Aug 20 06:48:46 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:46 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" released by "_copy_volume_from_snapshot" :: held 8.517s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" released by "_create_volume_from_snapshot" :: held 8.603s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.631s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.702s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-577651470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83238a27-0f42-47a8-be8e-0db30f36620b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3132a14ae419fba60f063e4ea5d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:48:39Z,use_quota=True,user_id='2c3f88ad24be45f2b263d78a7b67d83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Creating volume 83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:48:46 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:48:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:46 devstack sudo[110095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b 1073741824 Aug 20 06:48:46 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ea3834-74bf-4fc9-92ea-a5fb373e71c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec', 'volume_size': 1, 'snapshot_id': '6caa0b28-3c2f-4114-aa45-c52437bcbf2a'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a459b10d-7174-4b22-b11e-43bbdc670841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:47 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Volume volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec (ee4d9ba1-263d-415e-b3e0-3a56dec659ec): created successfully Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a459b10d-7174-4b22-b11e-43bbdc670841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Flow 'volume_create_manager' (31ea88d5-8239-4b1e-8935-190929172e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-11ed9e9b-00d6-404c-b39f-cfd8ad3fafef tempest-TestStampPattern-1013928246 None] Created volume successfully. Aug 20 06:48:47 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b 1073741824" returned: 0 in 0.665s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:47 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:48:47 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:47 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:48:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:48:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa198b8c-a7d0-4fd5-9b76-f1432b216326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83238a27-0f42-47a8-be8e-0db30f36620b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dfade3-85e0-4474-a727-65b0867acb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:48:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Volume volume-83238a27-0f42-47a8-be8e-0db30f36620b (83238a27-0f42-47a8-be8e-0db30f36620b): created successfully Aug 20 06:48:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dfade3-85e0-4474-a727-65b0867acb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:48:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Flow 'volume_create_manager' (a3be24e0-1e92-4b19-8069-7f798b7298c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:48:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f8230c90-e486-4ce6-a5fd-4938cb227f42 tempest-TestImageHashVerification-1564100187 None] Created volume successfully. Aug 20 06:48:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:48:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:48:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f515a-a633-4399-8a35-cd26992b2209]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:50 devstack sudo[110123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:48:50 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:50 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.552s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c34bc3-e4e2-41ec-85e7-f68990a53642]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:50 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:48:50 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:50 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.578s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b /opt/stack/data/cinder/conversion/83238a27-0f42-47a8-be8e-0db30f36620b.temp_image.83978570-bb75-4ad8-b969-daf4d17c8001uue8rn0_.img {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:50 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b /opt/stack/data/cinder/conversion/83238a27-0f42-47a8-be8e-0db30f36620b.temp_image.83978570-bb75-4ad8-b969-daf4d17c8001uue8rn0_.img Aug 20 06:48:50 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:57 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b /opt/stack/data/cinder/conversion/83238a27-0f42-47a8-be8e-0db30f36620b.temp_image.83978570-bb75-4ad8-b969-daf4d17c8001uue8rn0_.img" returned: 0 in 6.589s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e58888-cc62-4013-a1ee-3ad7d90b42e4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:48:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:48:57 devstack sudo[110201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:48:57 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:48:58 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:48:58 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root Aug 20 06:48:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.821s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:48:58 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/83238a27-0f42-47a8-be8e-0db30f36620b.temp_image.83978570-bb75-4ad8-b969-daf4d17c8001uue8rn0_.img {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:48:58 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Converted 1024.00 MB image at 155.38 MB/s Aug 20 06:48:58 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] 83978570-bb75-4ad8-b969-daf4d17c8001 was raw, no need to convert to raw {{(pid=94234) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 20 06:49:08 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:49:08 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=24,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (a93dac57-c146-4ea5-84ed-af18d662206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257c4a24-94b0-4087-9797-7819190892f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257c4a24-94b0-4087-9797-7819190892f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576777477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3a9353-26c5-4be7-bdb9-e0d7103c8137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:18Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dd822a-c801-4bdb-8f10-185de70a590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dd822a-c801-4bdb-8f10-185de70a590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952b822b-2251-46a3-85ee-b77539e6c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952b822b-2251-46a3-85ee-b77539e6c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3a9353-26c5-4be7-bdb9-e0d7103c8137', 'volume_name': 'volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30e7f0b-550c-4976-b964-530c4d97a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30e7f0b-550c-4976-b964-530c4d97a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec2cdb-0184-4ccf-b2d6-dadc160da440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume bc3a9353-26c5-4be7-bdb9-e0d7103c8137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137', 'volume_size': 1} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Flow 'volume_create_manager' (f2cbab7a-3809-4a83-81de-96918fe8f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f119f-74ea-4452-b1f4-fce4afdfc7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f119f-74ea-4452-b1f4-fce4afdfc7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-973070438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8d61d-0c9c-4eee-b110-9df8542b5921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ccfbf6dece4083998c14299b2f967c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:18Z,use_quota=True,user_id='1fc3507e0c0041e68849f149073a1a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e286fee7-bbe1-478a-8f97-6337a00c44f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e286fee7-bbe1-478a-8f97-6337a00c44f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9998bfce-d2bd-4ac7-8cb6-1866865b371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9998bfce-d2bd-4ac7-8cb6-1866865b371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d8d61d-0c9c-4eee-b110-9df8542b5921', 'volume_name': 'volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc504d5-ad67-4d3d-9a94-02fb4c39d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc504d5-ad67-4d3d-9a94-02fb4c39d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80417427-6dc5-41a9-9385-a64be07b5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Volume d9d8d61d-0c9c-4eee-b110-9df8542b5921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921', 'volume_size': 1} Aug 20 06:49:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:28 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=3 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:49:28 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.865s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Uploaded volume to glance image-id: 83978570-bb75-4ad8-b969-daf4d17c8001. {{(pid=94234) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.213s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576777477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3a9353-26c5-4be7-bdb9-e0d7103c8137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:18Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:29 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-567980b6-24d9-4599-b58d-6794075555d7 tempest-TestImageHashVerification-1564100187 None] Copy volume to image completed successfully. Aug 20 06:49:29 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 1073741824 Aug 20 06:49:29 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:30 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 1073741824" returned: 0 in 0.497s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:30 devstack sudo[110428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 Aug 20 06:49:30 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:30 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.900s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-973070438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8d61d-0c9c-4eee-b110-9df8542b5921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ccfbf6dece4083998c14299b2f967c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:18Z,use_quota=True,user_id='1fc3507e0c0041e68849f149073a1a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Creating volume d9d8d61d-0c9c-4eee-b110-9df8542b5921 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec2cdb-0184-4ccf-b2d6-dadc160da440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:30 devstack sudo[110431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 1073741824 Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fbcb2d-dd3c-451a-9695-4be845d17f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:30 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:30 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 (bc3a9353-26c5-4be7-bdb9-e0d7103c8137): created successfully Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fbcb2d-dd3c-451a-9695-4be845d17f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (a93dac57-c146-4ea5-84ed-af18d662206a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-acef3dd7-3d44-493f-b47c-6a0e50d3c4d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "cinder-83238a27-0f42-47a8-be8e-0db30f36620b-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "cinder-83238a27-0f42-47a8-be8e-0db30f36620b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "cinder-quobyte-83238a27-0f42-47a8-be8e-0db30f36620b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "cinder-quobyte-83238a27-0f42-47a8-be8e-0db30f36620b" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae676851-89a9-4d14-8204-c9abea187ac6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:30 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:49:30 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:30 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 1073741824" returned: 0 in 0.497s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:31 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 Aug 20 06:49:31 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:31 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:31 devstack sudo[110444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b Aug 20 06:49:31 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:31 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80417427-6dc5-41a9-9385-a64be07b5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1c2acf-269d-45dd-8ec0-a28bf8631422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Volume volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 (d9d8d61d-0c9c-4eee-b110-9df8542b5921): created successfully Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1c2acf-269d-45dd-8ec0-a28bf8631422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Flow 'volume_create_manager' (f2cbab7a-3809-4a83-81de-96918fe8f601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating offline snapshot 6ec2109d-f9bf-45db-9fab-8cafc2ba9429 of volume bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:49:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-42562eed-dfbe-4f9b-a4a5-71b3e8d12ccd tempest-TestMinimumBasicScenario-1320074261 None] Created volume successfully. Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c8d740-2de9-4abc-8c0a-064009a658c6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:31 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-83238a27-0f42-47a8-be8e-0db30f36620b" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "cinder-quobyte-83238a27-0f42-47a8-be8e-0db30f36620b" released by "delete_volume" :: held 0.765s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:31 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 Aug 20 06:49:31 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Created reservations ['5ccb55a6-9ea5-4d84-b602-731aecf8b12a', 'c663e2d2-2cf9-4bfd-8a41-d2d026946332', 'b59d6892-8b46-494d-bd8e-7a138d66d0a8', '78cefa63-bbf2-4a85-bf77-a7a67dde6435'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:31 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:31 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:31 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" returned: 0 in 0.375s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:31 devstack sudo[110455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 1G Aug 20 06:49:31 devstack sudo[110455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:31 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Deleted volume successfully. Aug 20 06:49:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3a300879-c7ed-4caa-a470-9ec4f995fe39 tempest-TestImageHashVerification-1564100187 None] Lock "cinder-83238a27-0f42-47a8-be8e-0db30f36620b-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:32 devstack sudo[110455]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 1G" returned: 0 in 0.511s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:32 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 Aug 20 06:49:32 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:32 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429" returned: 0 in 0.392s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:32 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 is being set with open permissions: ugo+rw Aug 20 06:49:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:32 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 Aug 20 06:49:32 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:33 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:33 devstack sudo[110481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info Aug 20 06:49:33 devstack sudo[110481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43dff21c-438b-4b39-8303-1bc1054aa938 req-65cbe5e0-51dc-42ae-adda-af5a98ead533 tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:33 devstack sudo[110481]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:33 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info is being set with open permissions: ugo+rw Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:33 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info Aug 20 06:49:33 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:33 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.info" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43dff21c-438b-4b39-8303-1bc1054aa938 req-65cbe5e0-51dc-42ae-adda-af5a98ead533 tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.509s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-43dff21c-438b-4b39-8303-1bc1054aa938 req-65cbe5e0-51dc-42ae-adda-af5a98ead533 tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7c297d54-535c-4401-ab32-798be9cef2f9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Create snapshot completed successfully Aug 20 06:49:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-43dff21c-438b-4b39-8303-1bc1054aa938 req-65cbe5e0-51dc-42ae-adda-af5a98ead533 tempest-TestMinimumBasicScenario-1320074261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aecbaf38-876c-4bbb-825b-8986f0414082', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:49:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-43dff21c-438b-4b39-8303-1bc1054aa938 req-65cbe5e0-51dc-42ae-adda-af5a98ead533 tempest-TestMinimumBasicScenario-1320074261 None] attachment_update completed successfully. Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:34 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:34 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:34 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.485s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:49:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (33f88a0a-bc5b-4182-85f3-7534eff8122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db6af39-c310-4b74-bd93-cb6289b5e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db6af39-c310-4b74-bd93-cb6289b5e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299538296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d078e07-6609-48c9-8b3b-1d7e8f0b11a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:35Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9680f1b-427d-4cde-98cb-0895339943f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9680f1b-427d-4cde-98cb-0895339943f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7041e4a-0289-44d8-acbf-003d79f42db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7041e4a-0289-44d8-acbf-003d79f42db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d078e07-6609-48c9-8b3b-1d7e8f0b11a8', 'volume_name': 'volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7be15-ff62-44cd-864c-edc55e8bafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7be15-ff62-44cd-864c-edc55e8bafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060d2d6-c26a-4f8a-b83b-121e15a5e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:35 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume 6d078e07-6609-48c9-8b3b-1d7e8f0b11a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8', 'volume_size': 1} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299538296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d078e07-6609-48c9-8b3b-1d7e8f0b11a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:35Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume 6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:35 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:35 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 1073741824 Aug 20 06:49:35 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:35 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (598f6350-576e-4c21-8c3b-e2107ebce386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f85a5-101a-43e0-9e18-2e0bc336a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f85a5-101a-43e0-9e18-2e0bc336a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367126546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec361762-0bc5-461e-91da-aa4e3bbf8138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:36Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb0ce2d-c602-4923-9a87-781c912e11d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb0ce2d-c602-4923-9a87-781c912e11d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc87821-bab4-46be-9e26-4a27b512b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc87821-bab4-46be-9e26-4a27b512b000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec361762-0bc5-461e-91da-aa4e3bbf8138', 'volume_name': 'volume-ec361762-0bc5-461e-91da-aa4e3bbf8138', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154bc4bc-3dbc-4443-8a10-36b942bc6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154bc4bc-3dbc-4443-8a10-36b942bc6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca52b00b-08a6-4cf8-9e89-d952bd62c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:36 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume ec361762-0bc5-461e-91da-aa4e3bbf8138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec361762-0bc5-461e-91da-aa4e3bbf8138', 'volume_size': 1} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:36 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 1073741824" returned: 0 in 1.088s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:36 devstack sudo[110895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 Aug 20 06:49:36 devstack sudo[110895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:36 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (fc85b443-e49a-4d2f-b50c-c6ebea6f3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510d86d0-84ee-43ac-b3bb-ba61f8de9be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510d86d0-84ee-43ac-b3bb-ba61f8de9be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628562058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540ac843-7d55-4ee9-8c7d-6cd6e96497bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:37Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeca4fee-e318-4393-afd6-3e22aa842e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeca4fee-e318-4393-afd6-3e22aa842e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef90b61-efb4-4717-a2c6-e8f95b01b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef90b61-efb4-4717-a2c6-e8f95b01b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540ac843-7d55-4ee9-8c7d-6cd6e96497bb', 'volume_name': 'volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49479b5-63da-4877-ad6f-2ab1e65bd56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49479b5-63da-4877-ad6f-2ab1e65bd56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2b2e6e-924b-44c3-9afb-8012d09a731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume 540ac843-7d55-4ee9-8c7d-6cd6e96497bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb', 'volume_size': 1} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:37 devstack sudo[110895]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" returned: 0 in 0.892s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367126546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec361762-0bc5-461e-91da-aa4e3bbf8138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:36Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume ec361762-0bc5-461e-91da-aa4e3bbf8138 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:37 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060d2d6-c26a-4f8a-b83b-121e15a5e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 1073741824 Aug 20 06:49:37 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d98765-23e6-47ca-be3e-cb42a76af2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d2372f72-b6c5-4cb0-8433-e4203224cf6c req-43f8eaab-eae4-46e6-8c5c-ed7b9ab7a1ab tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:37 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 (6d078e07-6609-48c9-8b3b-1d7e8f0b11a8): created successfully Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d98765-23e6-47ca-be3e-cb42a76af2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (33f88a0a-bc5b-4182-85f3-7534eff8122c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7fe451ef-cda1-4c8a-881a-44b34836b479 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (7717a8ce-f097-4760-ae90-a5d7d13e9dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f8983f-597b-44df-aac6-1e40f94b5523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f8983f-597b-44df-aac6-1e40f94b5523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716105211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32151eb2-b713-4d3c-8b65-d83ca31584c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:38Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7996f187-7a0a-4160-877e-0b5e74847907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7996f187-7a0a-4160-877e-0b5e74847907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403c4a50-4080-4a63-b913-38a88e01ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403c4a50-4080-4a63-b913-38a88e01ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32151eb2-b713-4d3c-8b65-d83ca31584c3', 'volume_name': 'volume-32151eb2-b713-4d3c-8b65-d83ca31584c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01aa0f0f-c6e1-4dd2-99c4-6a8dd58fb0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01aa0f0f-c6e1-4dd2-99c4-6a8dd58fb0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953a5362-03e4-4360-898e-45a261f92b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume 32151eb2-b713-4d3c-8b65-d83ca31584c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32151eb2-b713-4d3c-8b65-d83ca31584c3', 'volume_size': 1} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:38 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (e9dafca6-8979-4c17-9248-19887b813f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b64a76d-7e19-492f-a1d3-355e3e762e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 1073741824" returned: 0 in 1.078s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b64a76d-7e19-492f-a1d3-355e3e762e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907543106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547fc2f-9bec-43e1-b113-2b57cdfad3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:39Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a9429e-e199-4f05-b8ff-63f5d2535a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a9429e-e199-4f05-b8ff-63f5d2535a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b6dcac-d2c9-4ae1-817a-c94be3cbe1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b6dcac-d2c9-4ae1-817a-c94be3cbe1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1547fc2f-9bec-43e1-b113-2b57cdfad3ae', 'volume_name': 'volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0aeb70-fa20-49f0-bc9d-55731206146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0aeb70-fa20-49f0-bc9d-55731206146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1170b4ab-16e4-406c-a295-6fb312235f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume 1547fc2f-9bec-43e1-b113-2b57cdfad3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae', 'volume_size': 1} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:38 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 Aug 20 06:49:38 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:39 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138" returned: 0 in 0.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628562058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540ac843-7d55-4ee9-8c7d-6cd6e96497bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:37Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume 540ac843-7d55-4ee9-8c7d-6cd6e96497bb {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:39 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca52b00b-08a6-4cf8-9e89-d952bd62c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec361762-0bc5-461e-91da-aa4e3bbf8138', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32dee04-6387-43c0-968a-3b790b886ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:39 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb 1073741824 Aug 20 06:49:39 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 (ec361762-0bc5-461e-91da-aa4e3bbf8138): created successfully Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32dee04-6387-43c0-968a-3b790b886ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (598f6350-576e-4c21-8c3b-e2107ebce386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-38b549b9-f94c-467b-aac0-07301c525935 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:39 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb 1073741824" returned: 0 in 0.565s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:39 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb Aug 20 06:49:39 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:40 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" returned: 0 in 0.291s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d2372f72-b6c5-4cb0-8433-e4203224cf6c req-43f8eaab-eae4-46e6-8c5c-ed7b9ab7a1ab tempest-TestStampPattern-1013928246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.327s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2b2e6e-924b-44c3-9afb-8012d09a731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61bbe2-aca2-4c9f-9211-d562555798ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-d2372f72-b6c5-4cb0-8433-e4203224cf6c req-43f8eaab-eae4-46e6-8c5c-ed7b9ab7a1ab tempest-TestStampPattern-1013928246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716105211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32151eb2-b713-4d3c-8b65-d83ca31584c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:38Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume 32151eb2-b713-4d3c-8b65-d83ca31584c3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:40 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb (540ac843-7d55-4ee9-8c7d-6cd6e96497bb): created successfully Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61bbe2-aca2-4c9f-9211-d562555798ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (fc85b443-e49a-4d2f-b50c-c6ebea6f3107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:40 devstack sudo[110926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 1073741824 Aug 20 06:49:40 devstack sudo[110926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-33a68718-0f8d-42e7-8f13-5503816127b0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-d2372f72-b6c5-4cb0-8433-e4203224cf6c req-43f8eaab-eae4-46e6-8c5c-ed7b9ab7a1ab tempest-TestStampPattern-1013928246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37305275-9359-4a84-a294-675a63cc8be5', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:49:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-d2372f72-b6c5-4cb0-8433-e4203224cf6c req-43f8eaab-eae4-46e6-8c5c-ed7b9ab7a1ab tempest-TestStampPattern-1013928246 None] attachment_update completed successfully. Aug 20 06:49:40 devstack sudo[110926]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 1073741824" returned: 0 in 0.696s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:40 devstack sudo[110939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 Aug 20 06:49:40 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:41 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3" returned: 0 in 0.356s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907543106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547fc2f-9bec-43e1-b113-2b57cdfad3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a15f141a2e7481b87a677b139c3e743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:39Z,use_quota=True,user_id='4e1b786bd4394a488cdb619a356c7c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Creating volume 1547fc2f-9bec-43e1-b113-2b57cdfad3ae {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:41 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953a5362-03e4-4360-898e-45a261f92b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32151eb2-b713-4d3c-8b65-d83ca31584c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c93d1d-79c7-4dae-a6f2-cf00a8a46f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:41 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae 1073741824 Aug 20 06:49:41 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 (32151eb2-b713-4d3c-8b65-d83ca31584c3): created successfully Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c93d1d-79c7-4dae-a6f2-cf00a8a46f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (7717a8ce-f097-4760-ae90-a5d7d13e9dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d79d3eb6-9be3-495d-8df3-e6acaa93d9ad tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:41 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae 1073741824" returned: 0 in 0.622s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:42 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae Aug 20 06:49:42 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:42 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" returned: 0 in 0.340s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1170b4ab-16e4-406c-a295-6fb312235f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f19b3d-dc83-4835-81ed-6685050c3764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Volume volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae (1547fc2f-9bec-43e1-b113-2b57cdfad3ae): created successfully Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f19b3d-dc83-4835-81ed-6685050c3764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Flow 'volume_create_manager' (e9dafca6-8979-4c17-9248-19887b813f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7f2f2738-db09-4bae-8a03-255c65c188d0 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created volume successfully. Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-1547fc2f-9bec-43e1-b113-2b57cdfad3ae-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-1547fc2f-9bec-43e1-b113-2b57cdfad3ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" acquired by "delete_volume" :: waited 0.057s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1791e6-78df-457b-9e95-656e647a6f5b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:43 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae Aug 20 06:49:43 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-d1cd360a-6a55-47cc-9b61-a4fad7ca79c0 req-e811d5db-8085-42c2-8b97-808a1d2db530 tempest-TestStampPattern-1013928246 None] Terminate volume connection completed successfully. Aug 20 06:49:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-d1cd360a-6a55-47cc-9b61-a4fad7ca79c0 req-e811d5db-8085-42c2-8b97-808a1d2db530 tempest-TestStampPattern-1013928246 None] Deleting attachment 37305275-9359-4a84-a294-675a63cc8be5. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:49:44 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" returned: 0 in 0.499s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:44 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae Aug 20 06:49:44 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:44 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-1547fc2f-9bec-43e1-b113-2b57cdfad3ae" released by "delete_volume" :: held 0.905s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['b976a3ab-0261-4aee-a3eb-9f45514e653b', 'dc90da7f-e04d-4b13-8e9b-e66d0680a0e6', 'c31651f6-0b27-41fd-8ca0-4a0e6c6acb17', '9c07e377-a96b-46d4-ba91-6b4ca8e2f63b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:44 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:44 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:44 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.289s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:44 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:49:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-974d88d4-e776-4691-823c-21d8a807e2d9 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-1547fc2f-9bec-43e1-b113-2b57cdfad3ae-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-32151eb2-b713-4d3c-8b65-d83ca31584c3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-32151eb2-b713-4d3c-8b65-d83ca31584c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-32151eb2-b713-4d3c-8b65-d83ca31584c3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-32151eb2-b713-4d3c-8b65-d83ca31584c3" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24b728-3000-4da1-979f-c4935bbccccc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:46 devstack sudo[110994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 Aug 20 06:49:46 devstack sudo[110994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:46 devstack sudo[110994]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3" returned: 0 in 0.821s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:46 devstack sudo[111021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3 Aug 20 06:49:46 devstack sudo[111021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:47 devstack sudo[111021]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-32151eb2-b713-4d3c-8b65-d83ca31584c3" returned: 0 in 0.400s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-32151eb2-b713-4d3c-8b65-d83ca31584c3" released by "delete_volume" :: held 1.309s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['7ad4654f-2450-4415-9c94-1f31b6283687', '88a034f8-3a58-470a-a4ba-5fb83f12db27', 'f62f4960-4c9e-4497-9a44-183af43eaa5a', '36409ac9-0747-4cea-99a3-7f88ec026215'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:47 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:47 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:47 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-56ac9ccd-3979-4f9b-a555-eb9b2909631b tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-32151eb2-b713-4d3c-8b65-d83ca31584c3-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-540ac843-7d55-4ee9-8c7d-6cd6e96497bb-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-540ac843-7d55-4ee9-8c7d-6cd6e96497bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d727ab-a301-4170-a0e4-2179e58e2cf0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:48 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb Aug 20 06:49:48 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:49 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" returned: 0 in 0.707s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:49 devstack sudo[111039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb Aug 20 06:49:49 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-ee4d9ba1-263d-415e-b3e0-3a56dec659ec-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "cinder-ee4d9ba1-263d-415e-b3e0-3a56dec659ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd7b8c-e024-4aac-ae29-4334c979c605]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:49 devstack sudo[111041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec Aug 20 06:49:49 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:49 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" returned: 0 in 0.424s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-540ac843-7d55-4ee9-8c7d-6cd6e96497bb" released by "delete_volume" :: held 1.232s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['85cc5dd8-2800-4eab-a44e-2522c80bf7fa', '6b2c236e-901e-4a4d-9580-f62efe063710', '42f7b2c5-06a7-423a-88d6-554032a2b93a', 'a66d91b2-20ad-4484-a6e7-ae0951990a92'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:49 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:49 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:49 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" returned: 0 in 0.506s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:49 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec Aug 20 06:49:49 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:50 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.386s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1a3509d-070d-4ec0-a55c-6fee132cc697 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-540ac843-7d55-4ee9-8c7d-6cd6e96497bb-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:50 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" returned: 0 in 0.342s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-ee4d9ba1-263d-415e-b3e0-3a56dec659ec" released by "delete_volume" :: held 0.911s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Created reservations ['2c50b8f9-171c-4061-8fff-7dee1bca103b', '237a9e2c-14a5-4ece-bad4-3288f1a60d40', 'b418297b-222c-4f5a-95df-01c2ddb4d52e', 'b5883810-24ae-426a-92f0-6a06618f8f29'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:50 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:50 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-ec361762-0bc5-461e-91da-aa4e3bbf8138-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-ec361762-0bc5-461e-91da-aa4e3bbf8138-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:50 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.295s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-ec361762-0bc5-461e-91da-aa4e3bbf8138" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Deleted volume successfully. Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-341e6940-ab6c-48f2-8330-e8e0ccc10f97 tempest-TestStampPattern-1013928246 None] Lock "cinder-ee4d9ba1-263d-415e-b3e0-3a56dec659ec-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-ec361762-0bc5-461e-91da-aa4e3bbf8138" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[691fbc79-63b4-45c4-a236-f8062b65ea6c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:50 devstack sudo[111056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 Aug 20 06:49:50 devstack sudo[111056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:51 devstack sudo[111056]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:51 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138 Aug 20 06:49:51 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (356f4684-7024-491d-993b-7d2e6be9bf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1533e2-1641-4441-a836-371866d91d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1533e2-1641-4441-a836-371866d91d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296490123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b09982-4a3b-4155-9c99-9ae8be540cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:51Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f7820-e850-421f-8077-f919bf820c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f7820-e850-421f-8077-f919bf820c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6cb7b4-438e-427e-9dd2-ab97e8946423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6cb7b4-438e-427e-9dd2-ab97e8946423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b09982-4a3b-4155-9c99-9ae8be540cdc', 'volume_name': 'volume-91b09982-4a3b-4155-9c99-9ae8be540cdc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b98f61e-1ee6-41c1-9473-d9cafa7662bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b98f61e-1ee6-41c1-9473-d9cafa7662bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4c1afa-514f-4bed-b8af-d83b2f333025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Volume 91b09982-4a3b-4155-9c99-9ae8be540cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b09982-4a3b-4155-9c99-9ae8be540cdc', 'volume_size': 1} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296490123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b09982-4a3b-4155-9c99-9ae8be540cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:51Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Creating volume 91b09982-4a3b-4155-9c99-9ae8be540cdc {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:51 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:51 devstack sudo[111063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc 1073741824 Aug 20 06:49:51 devstack sudo[111063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:51 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-ec361762-0bc5-461e-91da-aa4e3bbf8138" returned: 0 in 0.427s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-ec361762-0bc5-461e-91da-aa4e3bbf8138" released by "delete_volume" :: held 0.949s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (616146e1-530a-42de-896c-7e7a3d318cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adab67fd-2972-49e7-a7a3-7543183af57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adab67fd-2972-49e7-a7a3-7543183af57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2117310307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dd50cd-6316-43bf-8365-c8e10452ebb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:52Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa565fd7-947f-41d2-b038-a915e723577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa565fd7-947f-41d2-b038-a915e723577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0841dda8-2945-4365-a384-24d1a5fe9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0841dda8-2945-4365-a384-24d1a5fe9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7dd50cd-6316-43bf-8365-c8e10452ebb4', 'volume_name': 'volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9157c450-d1a1-4bdf-bb5d-6713456cdff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9157c450-d1a1-4bdf-bb5d-6713456cdff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad52741-7647-4955-9e38-453b1423cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Volume e7dd50cd-6316-43bf-8365-c8e10452ebb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4', 'volume_size': 1} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['1029e2e6-937c-40ed-beb3-48975199a22e', '949f0332-4965-47cf-81d2-b49518a9ecbc', '54728ffd-0273-4183-9efe-28389892041a', '772344b0-bd31-4c97-aa9a-1d6e841b689f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:52 devstack sudo[111063]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Deleting offline snapshot 6caa0b28-3c2f-4114-aa45-c52437bcbf2a of volume da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] snapshot_file for this snap is: volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc 1073741824" returned: 0 in 0.876s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f578f0-243e-446a-b15d-4eea6aa5fbff]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:52 devstack sudo[111071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc Aug 20 06:49:52 devstack sudo[111071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:52 devstack sudo[111072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:52 devstack sudo[111072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (13e07f32-fdf6-4d45-8562-0e596117dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:52 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cde668-5dd3-4c52-83df-2d41f0389f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cde668-5dd3-4c52-83df-2d41f0389f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800668547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100d9a61-2fd7-41ba-912c-ca91386325d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:52Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f922fa4-cd5e-46a8-9a16-f6d626b5eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f922fa4-cd5e-46a8-9a16-f6d626b5eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b9bd8-5212-47eb-a8e8-4de39bb4f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b9bd8-5212-47eb-a8e8-4de39bb4f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100d9a61-2fd7-41ba-912c-ca91386325d6', 'volume_name': 'volume-100d9a61-2fd7-41ba-912c-ca91386325d6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28857598-fe46-4656-ae8a-51c46d1f8231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28857598-fe46-4656-ae8a-51c46d1f8231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53e6f68-306b-4e8f-b87d-52f1bf35dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Volume 100d9a61-2fd7-41ba-912c-ca91386325d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100d9a61-2fd7-41ba-912c-ca91386325d6', 'volume_size': 1} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:52 devstack sudo[111071]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc" returned: 0 in 0.413s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2117310307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dd50cd-6316-43bf-8365-c8e10452ebb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:52Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Creating volume e7dd50cd-6316-43bf-8365-c8e10452ebb4 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:52 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:52 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 1073741824 Aug 20 06:49:52 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4c1afa-514f-4bed-b8af-d83b2f333025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b09982-4a3b-4155-9c99-9ae8be540cdc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dc4231-e60a-4d98-8006-02f0abd87441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Volume volume-91b09982-4a3b-4155-9c99-9ae8be540cdc (91b09982-4a3b-4155-9c99-9ae8be540cdc): created successfully Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dc4231-e60a-4d98-8006-02f0abd87441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:52 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (356f4684-7024-491d-993b-7d2e6be9bf80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.642s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da2d486c-9215-44f8-af27-c67359fefe2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:49:52 devstack sudo[111072]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ef292d-ac7f-49f9-b14c-763db40a939b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:49:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-eb56b7a0-097a-483f-82b7-485f6de6d270 tempest-CreateVolumesFromImageTest-111015358 None] Created volume successfully. Aug 20 06:49:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-84f815fc-8e13-4965-8d2f-feb11acc8057 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-ec361762-0bc5-461e-91da-aa4e3bbf8138-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:53 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:49:53 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea7c50-21c7-4f83-ae08-66710328a16e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (9293f1c9-9315-4af1-9d0f-e1090dc5ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e8bee-6551-473a-9164-950cc2c8e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:53 devstack sudo[111099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 Aug 20 06:49:53 devstack sudo[111099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:53 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e8bee-6551-473a-9164-950cc2c8e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343109800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13029af-2976-4496-856a-392dba51f9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:53Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24aad2c8-3e30-4971-8b71-dd6180f19bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24aad2c8-3e30-4971-8b71-dd6180f19bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aefea2c-5346-4511-bd90-c313be6209ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aefea2c-5346-4511-bd90-c313be6209ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13029af-2976-4496-856a-392dba51f9ba', 'volume_name': 'volume-f13029af-2976-4496-856a-392dba51f9ba', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e5b22c-f5a2-4501-b1d4-d76cf71a375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e5b22c-f5a2-4501-b1d4-d76cf71a375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3bb4d8-984b-4f4e-970f-a767629954d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Volume f13029af-2976-4496-856a-392dba51f9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13029af-2976-4496-856a-392dba51f9ba', 'volume_size': 1} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 1073741824" returned: 0 in 0.983s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:53 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.895s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:53 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 Aug 20 06:49:53 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:53 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:49:53 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:53 devstack sudo[111099]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" returned: 0 in 0.709s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:49:54 devstack sudo[111114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8 Aug 20 06:49:54 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (b80c1cd7-bb34-4048-81c2-1a79e09481a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b53fa7-d76a-423c-b6a1-f7457a67db71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b53fa7-d76a-423c-b6a1-f7457a67db71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338498617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f41a1e-2cb1-4047-b4e5-a170bbd2e378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:54Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c153f3b5-8783-4c6f-b919-20da6a2205db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c153f3b5-8783-4c6f-b919-20da6a2205db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8d8b2c-b032-447d-a9c8-31a021a518d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8d8b2c-b032-447d-a9c8-31a021a518d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f41a1e-2cb1-4047-b4e5-a170bbd2e378', 'volume_name': 'volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26679b34-f3a2-4b5d-a34c-58e18a6ddd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26679b34-f3a2-4b5d-a34c-58e18a6ddd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1530b987-9cf4-4b9d-adf2-3fa284cd9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Volume 55f41a1e-2cb1-4047-b4e5-a170bbd2e378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378', 'volume_size': 1} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:54 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4" returned: 0 in 0.538s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800668547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100d9a61-2fd7-41ba-912c-ca91386325d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:52Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Creating volume 100d9a61-2fd7-41ba-912c-ca91386325d6 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad52741-7647-4955-9e38-453b1423cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec291e6-3a59-4d0f-bd04-7e8d89f1e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" returned: 0 in 0.381s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 1073741824 Aug 20 06:49:54 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Volume volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 (e7dd50cd-6316-43bf-8365-c8e10452ebb4): created successfully Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec291e6-3a59-4d0f-bd04-7e8d89f1e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (616146e1-530a-42de-896c-7e7a3d318cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8" released by "delete_volume" :: held 1.176s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:54 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.584s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-70470a83-b0c0-483a-b4f4-68528cc82c78 tempest-CreateVolumesFromImageTest-111015358 None] Created volume successfully. Aug 20 06:49:54 devstack sudo[111148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a Aug 20 06:49:54 devstack sudo[111148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['5a4fddbd-79b9-40c6-b5c1-0b10ef61ee37', 'f82c25d1-67d7-47dd-a67d-cb31a5bf8c1f', '10530025-5b3f-4796-af02-f6906e78afb8', '9df38e15-3506-45a9-a44f-9a99af4d5905'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:54 devstack sudo[111164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:54 devstack sudo[111164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:54 devstack sudo[111148]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a.6caa0b28-3c2f-4114-aa45-c52437bcbf2a" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-6caa0b28-3c2f-4114-aa45-c52437bcbf2a" released by "_delete_snapshot" :: held 2.594s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" released by "delete_snapshot" :: held 2.683s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Created reservations ['761534d5-89e2-4bc8-8493-370bb12a0614', 'c7456d78-00cb-4306-8caa-aea2c42a15be', 'c745ff7a-a92e-45a9-9ed8-7d500884d946', 'ec9d77f0-0152-47d8-9fc7-95d0d78b92d4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:54 devstack sudo[111164]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.279s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:49:54 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 1073741824" returned: 0 in 0.540s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Delete snapshot completed successfully. Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-765ba814-aa87-4750-8295-386b75149c0d tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-6d078e07-6609-48c9-8b3b-1d7e8f0b11a8-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-15b1a2be-3986-4bf5-a8d0-9e735936f110 tempest-TestStampPattern-1013928246 None] Lock "cinder-6caa0b28-3c2f-4114-aa45-c52437bcbf2a-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:54 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 Aug 20 06:49:54 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:55 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343109800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13029af-2976-4496-856a-392dba51f9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:53Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Creating volume f13029af-2976-4496-856a-392dba51f9ba {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:55 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53e6f68-306b-4e8f-b87d-52f1bf35dab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100d9a61-2fd7-41ba-912c-ca91386325d6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:55 devstack sudo[111197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba 1073741824 Aug 20 06:49:55 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df071e5-2c04-4bfd-bcc7-cad0f0609710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Volume volume-100d9a61-2fd7-41ba-912c-ca91386325d6 (100d9a61-2fd7-41ba-912c-ca91386325d6): created successfully Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df071e5-2c04-4bfd-bcc7-cad0f0609710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (13e07f32-fdf6-4d45-8562-0e596117dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d8fada0f-87f8-4d12-9eee-7b58dd9bdc0c tempest-CreateVolumesFromImageTest-111015358 None] Created volume successfully. Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-6ec2109d-f9bf-45db-9fab-8cafc2ba9429-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-6ec2109d-f9bf-45db-9fab-8cafc2ba9429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-6ec2109d-f9bf-45db-9fab-8cafc2ba9429" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-6ec2109d-f9bf-45db-9fab-8cafc2ba9429" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleting offline snapshot 6ec2109d-f9bf-45db-9fab-8cafc2ba9429 of volume bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] snapshot_file for this snap is: volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcbb1f-63b0-4d77-a42b-bb50dc425389]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:55 devstack sudo[111202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 Aug 20 06:49:55 devstack sudo[111202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:55 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba 1073741824" returned: 0 in 0.501s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:55 devstack sudo[111205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba Aug 20 06:49:55 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:55 devstack sudo[111202]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429" returned: 0 in 0.397s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4bc67-75ee-4196-8404-9ad660442496]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:56 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba" returned: 0 in 0.364s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338498617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f41a1e-2cb1-4047-b4e5-a170bbd2e378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5790f7a0b13b4871b980fde94ad51e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:49:54Z,use_quota=True,user_id='565108ca0ef746cf978b3e5d85c15f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Creating volume 55f41a1e-2cb1-4047-b4e5-a170bbd2e378 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:49:56 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:56 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 Aug 20 06:49:56 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3bb4d8-984b-4f4e-970f-a767629954d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13029af-2976-4496-856a-392dba51f9ba', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:56 devstack sudo[111213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 1073741824 Aug 20 06:49:56 devstack sudo[111213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c2acd-0c79-48aa-8edf-8e2b09edc6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:56 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Volume volume-f13029af-2976-4496-856a-392dba51f9ba (f13029af-2976-4496-856a-392dba51f9ba): created successfully Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c2acd-0c79-48aa-8edf-8e2b09edc6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (9293f1c9-9315-4af1-9d0f-e1090dc5ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-345db9ec-2fa8-4b85-8ad5-6ac322576a0a tempest-CreateVolumesFromImageTest-111015358 None] Created volume successfully. Aug 20 06:49:56 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" returned: 0 in 0.738s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:56 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 Aug 20 06:49:56 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:56 devstack sudo[111213]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 1073741824" returned: 0 in 0.706s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:56 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 Aug 20 06:49:56 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:57 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429" returned: 0 in 0.609s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:57 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" returned: 0 in 0.446s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:57 devstack sudo[111252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429 Aug 20 06:49:57 devstack sudo[111252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1530b987-9cf4-4b9d-adf2-3fa284cd9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f96287-9c58-45a1-a412-3a926624ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:49:57 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Volume volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 (55f41a1e-2cb1-4047-b4e5-a170bbd2e378): created successfully Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f96287-9c58-45a1-a412-3a926624ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Flow 'volume_create_manager' (b80c1cd7-bb34-4048-81c2-1a79e09481a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:49:57 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-72ac8607-4863-4797-afae-e2321cfc78f9 tempest-CreateVolumesFromImageTest-111015358 None] Created volume successfully. Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-55f41a1e-2cb1-4047-b4e5-a170bbd2e378-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-55f41a1e-2cb1-4047-b4e5-a170bbd2e378-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-quobyte-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[67524650-acf0-49c6-9d6e-32641ef336fd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:57 devstack sudo[111252]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137.6ec2109d-f9bf-45db-9fab-8cafc2ba9429" returned: 0 in 0.506s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-6ec2109d-f9bf-45db-9fab-8cafc2ba9429" released by "_delete_snapshot" :: held 2.411s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" released by "delete_snapshot" :: held 2.441s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:57 devstack sudo[111261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 Aug 20 06:49:57 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['582745bc-9a16-4172-a398-ed8f70b2d907', '8154a38e-f20d-4c4e-b743-3ad97c9325dd', '559f909c-5f12-4da8-808d-dcac68fedd87', '08357a3d-f894-4980-bb3f-b6401b9841d9'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Delete snapshot completed successfully. Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-978f90aa-5c1e-4925-8e1a-f187047a7447 tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-6ec2109d-f9bf-45db-9fab-8cafc2ba9429-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:58 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" returned: 0 in 0.465s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:58 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378 Aug 20 06:49:58 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:58 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" returned: 0 in 0.289s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-55f41a1e-2cb1-4047-b4e5-a170bbd2e378" released by "delete_volume" :: held 0.808s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Created reservations ['a907a4ad-84b2-4ade-a76c-aaaca6ce0fd7', '7e5da27f-0bd5-44d7-98e2-9d402f5ff42c', '57d02460-6e35-4eca-8b81-3b9680b2a17a', '20ffff49-46e3-4918-917d-1965de6e602b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-bc3a9353-26c5-4be7-bdb9-e0d7103c8137-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-bc3a9353-26c5-4be7-bdb9-e0d7103c8137-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:58 devstack sudo[111271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:49:58 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-f13029af-2976-4496-856a-392dba51f9ba-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e37b0-c8d8-420c-9f72-bb6ca2fa217e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-f13029af-2976-4496-856a-392dba51f9ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-quobyte-f13029af-2976-4496-856a-392dba51f9ba" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-f13029af-2976-4496-856a-392dba51f9ba" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[37739151-af1f-42bc-b7be-b50d5b4be57b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:59 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 Aug 20 06:49:59 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:59 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:49:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Deleted volume successfully. Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a45457d2-48c1-49f1-8be9-c30202357234 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-55f41a1e-2cb1-4047-b4e5-a170bbd2e378-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:59 devstack sudo[111274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba Aug 20 06:49:59 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-da2d486c-9215-44f8-af27-c67359fefe2a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:59 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" returned: 0 in 0.564s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "cinder-da2d486c-9215-44f8-af27-c67359fefe2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:59 devstack sudo[111283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137 Aug 20 06:49:59 devstack sudo[111283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Acquiring lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:49:59 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba" returned: 0 in 0.517s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:49:59 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba Aug 20 06:49:59 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef53d54-45cf-4907-8fca-997e2fadb6d0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:49:59 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:49:59 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:49:59 devstack sudo[111283]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" returned: 0 in 0.289s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-quobyte-bc3a9353-26c5-4be7-bdb9-e0d7103c8137" released by "delete_volume" :: held 0.942s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:59 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Created reservations ['3c775854-57cc-4258-8d7c-158a95af312c', 'b8926fc5-bb9a-43f5-bdbe-f81c5aadd53a', 'fc3c3bcb-b521-4b58-86d2-4ab4ce41cbe3', '646c600c-2e3d-4838-a710-fc9e84590b8e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f13029af-2976-4496-856a-392dba51f9ba" returned: 0 in 0.293s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-f13029af-2976-4496-856a-392dba51f9ba" released by "delete_volume" :: held 0.872s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:49:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Created reservations ['7f00afd6-6574-44ae-9bbf-d0422593a506', '23f3d709-ad9f-4a3d-b574-d7cd846ad263', '53e7a69b-4e51-4939-a422-b44d44aa583d', 'f570ff72-94ea-49bd-9b0b-abe5635b1d12'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:00 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:00 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:00 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.443s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:00 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a Aug 20 06:50:00 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:00 devstack sudo[111300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:00 devstack sudo[111300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:00 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Deleted volume successfully. Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-09fdbcfd-a1a1-4c6a-8a18-9d2d952565fb tempest-CreateVolumesFromSnapshotTest-1390639600 None] Lock "cinder-bc3a9353-26c5-4be7-bdb9-e0d7103c8137-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:00 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-da2d486c-9215-44f8-af27-c67359fefe2a" returned: 0 in 0.304s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "cinder-quobyte-da2d486c-9215-44f8-af27-c67359fefe2a" released by "delete_volume" :: held 0.816s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:00 devstack sudo[111300]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.277s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Deleted volume successfully. Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-494cf220-1a91-4f7c-b088-2f195f47dd13 tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-f13029af-2976-4496-856a-392dba51f9ba-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Created reservations ['c3572db7-d41a-44a4-ae5d-0632a4675360', 'd5af6d3d-afad-4c1f-9a7c-1539f6a16eeb', 'c8703d3c-1627-427a-9b74-90eeb7007d99', '62530e4e-8389-4f7a-97e4-f682c271a64e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:00 devstack sudo[111305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:00 devstack sudo[111305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:00 devstack sudo[111305]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.276s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Deleted volume successfully. Aug 20 06:50:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dbbea0b7-d1d0-4021-acc8-b421b16dc564 tempest-TestStampPattern-1013928246 None] Lock "cinder-da2d486c-9215-44f8-af27-c67359fefe2a-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-100d9a61-2fd7-41ba-912c-ca91386325d6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-100d9a61-2fd7-41ba-912c-ca91386325d6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-quobyte-100d9a61-2fd7-41ba-912c-ca91386325d6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-100d9a61-2fd7-41ba-912c-ca91386325d6" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef4cf5-d753-400d-8d93-81e9de0bfdb8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:01 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 Aug 20 06:50:01 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:01 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6" returned: 0 in 0.418s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:01 devstack sudo[111322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6 Aug 20 06:50:01 devstack sudo[111322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:02 devstack sudo[111322]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-100d9a61-2fd7-41ba-912c-ca91386325d6" returned: 0 in 0.312s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-100d9a61-2fd7-41ba-912c-ca91386325d6" released by "delete_volume" :: held 0.787s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Created reservations ['f010d470-35ff-406d-8bc1-c15f700e5912', '193a1172-0cdf-4bf7-8841-0aed333b3ee4', '241c4e41-5211-4d4c-950f-63c0b84fca32', '538d5267-cd10-4399-b353-57c38a9a62b1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:02 devstack sudo[111325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:02 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-e7dd50cd-6316-43bf-8365-c8e10452ebb4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-e7dd50cd-6316-43bf-8365-c8e10452ebb4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-quobyte-e7dd50cd-6316-43bf-8365-c8e10452ebb4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-e7dd50cd-6316-43bf-8365-c8e10452ebb4" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43afa74-7e9c-44ef-8f4d-d868b1e7bb34]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:02 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Deleted volume successfully. Aug 20 06:50:02 devstack sudo[111327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 Aug 20 06:50:02 devstack sudo[111327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bc3a1ff7-54e1-410d-9e62-0ba1bc9c14eb tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-100d9a61-2fd7-41ba-912c-ca91386325d6-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:03 devstack sudo[111327]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4" returned: 0 in 0.461s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:03 devstack sudo[111333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4 Aug 20 06:50:03 devstack sudo[111333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:03 devstack sudo[111333]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e7dd50cd-6316-43bf-8365-c8e10452ebb4" returned: 0 in 0.320s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-e7dd50cd-6316-43bf-8365-c8e10452ebb4" released by "delete_volume" :: held 0.838s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Created reservations ['387af293-b390-4d29-ba3b-1c0e67bd51f2', '69f83311-b78e-409f-9ff8-47d6e14b7c29', 'ad7e5470-d150-4bbe-8bbe-abcf55fa3c9e', 'b739d7eb-6fea-4728-a1e8-aeec7559b4ca'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:03 devstack sudo[111339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:03 devstack sudo[111339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-91b09982-4a3b-4155-9c99-9ae8be540cdc-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-91b09982-4a3b-4155-9c99-9ae8be540cdc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "cinder-quobyte-91b09982-4a3b-4155-9c99-9ae8be540cdc" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-91b09982-4a3b-4155-9c99-9ae8be540cdc" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eb4939-b58a-4e79-bdf3-9b5bb48b760a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:03 devstack sudo[111339]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Deleted volume successfully. Aug 20 06:50:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-76ddbcda-2a9e-4c7e-bd9d-8bda05cd1e8e tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-e7dd50cd-6316-43bf-8365-c8e10452ebb4-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:03 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc Aug 20 06:50:03 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:04 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc" returned: 0 in 0.455s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:04 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc Aug 20 06:50:04 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:04 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-91b09982-4a3b-4155-9c99-9ae8be540cdc" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-quobyte-91b09982-4a3b-4155-9c99-9ae8be540cdc" released by "delete_volume" :: held 0.866s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Created reservations ['fc6c1eda-5433-4574-9fe9-e3ceccc84536', 'ecb1609e-8cc2-4470-b02e-9bb3447ee750', 'b17f03c2-cad1-4138-b771-4ddf0d125105', '03d507d6-71b0-40dd-9c66-75628ae7548c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:04 devstack sudo[111367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:04 devstack sudo[111367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:05 devstack sudo[111367]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:05 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Deleted volume successfully. Aug 20 06:50:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-08a8a4be-3c57-4a85-b89c-0ade198240df tempest-CreateVolumesFromImageTest-111015358 None] Lock "cinder-91b09982-4a3b-4155-9c99-9ae8be540cdc-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Flow 'volume_create_manager' (b9fd030d-f4bd-40f6-9f5f-ee0ea63ef3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f87fb4-7502-49ae-b58a-579591456617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f87fb4-7502-49ae-b58a-579591456617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9050025b-0c74-44c4-9c42-017d2373612d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474efbf335cd4263b687426e269e433e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:10Z,use_quota=True,user_id='9bf2d6a9cb854f9d893b9f8e3ffb7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b3d82-a8bf-40e6-bcb9-1ca77c834121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b3d82-a8bf-40e6-bcb9-1ca77c834121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ced8f4-f1d6-472b-b00b-d0cd642d0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ced8f4-f1d6-472b-b00b-d0cd642d0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9050025b-0c74-44c4-9c42-017d2373612d', 'volume_name': 'volume-9050025b-0c74-44c4-9c42-017d2373612d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabb5d63-1e7d-421f-b3d6-96ce7a9f90c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabb5d63-1e7d-421f-b3d6-96ce7a9f90c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c9148b-6cc9-4ee3-a90a-c71d032aaf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Volume 9050025b-0c74-44c4-9c42-017d2373612d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9050025b-0c74-44c4-9c42-017d2373612d', 'volume_size': 1} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9050025b-0c74-44c4-9c42-017d2373612d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474efbf335cd4263b687426e269e433e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:10Z,use_quota=True,user_id='9bf2d6a9cb854f9d893b9f8e3ffb7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Creating volume 9050025b-0c74-44c4-9c42-017d2373612d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:10 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:10 devstack sudo[111401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d 1073741824 Aug 20 06:50:10 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:10 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d 1073741824" returned: 0 in 0.571s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:10 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d Aug 20 06:50:10 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:11 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d" returned: 0 in 0.489s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c9148b-6cc9-4ee3-a90a-c71d032aaf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9050025b-0c74-44c4-9c42-017d2373612d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19520aa8-70ab-4061-9447-2cf2083d9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:11 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Volume volume-9050025b-0c74-44c4-9c42-017d2373612d (9050025b-0c74-44c4-9c42-017d2373612d): created successfully Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19520aa8-70ab-4061-9447-2cf2083d9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:11 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Flow 'volume_create_manager' (b9fd030d-f4bd-40f6-9f5f-ee0ea63ef3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-77daedab-414e-476f-918e-2d5aa0d269b3 tempest-CinderUnicodeTest-2140489304 None] Created volume successfully. Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Flow 'volume_create_manager' (df004516-5061-467c-b021-678c194b1244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8724544e-454b-4b8a-9fbc-04b5467f79bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8724544e-454b-4b8a-9fbc-04b5467f79bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2106850976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61009f01-0606-4271-92bb-16d87eb70927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474efbf335cd4263b687426e269e433e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:13Z,use_quota=True,user_id='9bf2d6a9cb854f9d893b9f8e3ffb7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d2959-f6d1-42d0-8e23-850824a64878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d2959-f6d1-42d0-8e23-850824a64878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8600a0-2cf0-40e1-bd05-6a107629abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8600a0-2cf0-40e1-bd05-6a107629abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61009f01-0606-4271-92bb-16d87eb70927', 'volume_name': 'volume-61009f01-0606-4271-92bb-16d87eb70927', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ced305-9a3c-4ad4-a339-5bc43a6ba9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ced305-9a3c-4ad4-a339-5bc43a6ba9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c249f5-36df-4349-aa25-7a57db0315a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Volume 61009f01-0606-4271-92bb-16d87eb70927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61009f01-0606-4271-92bb-16d87eb70927', 'volume_size': 1} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2106850976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61009f01-0606-4271-92bb-16d87eb70927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474efbf335cd4263b687426e269e433e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:13Z,use_quota=True,user_id='9bf2d6a9cb854f9d893b9f8e3ffb7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Creating volume 61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:13 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:13 devstack sudo[111411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 1073741824 Aug 20 06:50:13 devstack sudo[111411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:14 devstack sudo[111411]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 1073741824" returned: 0 in 0.658s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:14 devstack sudo[111418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 Aug 20 06:50:14 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:14 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927" returned: 0 in 0.403s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c249f5-36df-4349-aa25-7a57db0315a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61009f01-0606-4271-92bb-16d87eb70927', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32342c49-4d3a-4ebe-bdba-a01e01321c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Volume volume-61009f01-0606-4271-92bb-16d87eb70927 (61009f01-0606-4271-92bb-16d87eb70927): created successfully Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32342c49-4d3a-4ebe-bdba-a01e01321c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Flow 'volume_create_manager' (df004516-5061-467c-b021-678c194b1244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ad0011e3-567d-41f9-b70d-34e083c8d4eb tempest-CinderUnicodeTest-2140489304 None] Created volume successfully. Aug 20 06:50:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Creating offline snapshot 7abacb6d-0528-45af-8342-3931afc8335b of volume 61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:50:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c123f-db8f-4056-8971-93813a89cafe]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:15 devstack sudo[111421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 Aug 20 06:50:15 devstack sudo[111421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:16 devstack sudo[111421]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927" returned: 0 in 0.594s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:16 devstack sudo[111426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b 1G Aug 20 06:50:16 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:17 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b 1G" returned: 0 in 0.574s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61009f01-0606-4271-92bb-16d87eb70927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:17 devstack sudo[111432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61009f01-0606-4271-92bb-16d87eb70927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b Aug 20 06:50:17 devstack sudo[111432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:17 devstack sudo[111432]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61009f01-0606-4271-92bb-16d87eb70927 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:17 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b is being set with open permissions: ugo+rw Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:17 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b Aug 20 06:50:17 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:17 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:17 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info Aug 20 06:50:17 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:18 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info" returned: 0 in 0.303s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info is being set with open permissions: ugo+rw Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:18 devstack sudo[111445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info Aug 20 06:50:18 devstack sudo[111445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:18 devstack sudo[111445]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.info" returned: 0 in 0.299s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:18 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f953dd1b-fc03-4d83-824f-87928bab5090 tempest-CinderUnicodeTest-2140489304 None] Create snapshot completed successfully Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (8fcbb027-d58f-4f63-8ce5-c76635002283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa315cd0-13a4-4675-9445-112d3854d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa315cd0-13a4-4675-9445-112d3854d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597312975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0eb9fa-ed27-4592-8e95-d60008827535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:19Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa90c7db-3b99-4a79-bb60-2b6c8b0c0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa90c7db-3b99-4a79-bb60-2b6c8b0c0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c74ce-2610-4cb3-a2a4-9effefc66fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c74ce-2610-4cb3-a2a4-9effefc66fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0eb9fa-ed27-4592-8e95-d60008827535', 'volume_name': 'volume-8d0eb9fa-ed27-4592-8e95-d60008827535', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ae17d5-8c03-4e63-b1a4-7de0bcf9bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ae17d5-8c03-4e63-b1a4-7de0bcf9bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bb59d-032a-49c5-9899-eb58f8f8dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume 8d0eb9fa-ed27-4592-8e95-d60008827535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0eb9fa-ed27-4592-8e95-d60008827535', 'volume_size': 1} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597312975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0eb9fa-ed27-4592-8e95-d60008827535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:19Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume 8d0eb9fa-ed27-4592-8e95-d60008827535 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:18 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:18 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 1073741824 Aug 20 06:50:18 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:18 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-7abacb6d-0528-45af-8342-3931afc8335b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-7abacb6d-0528-45af-8342-3931afc8335b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-quobyte-7abacb6d-0528-45af-8342-3931afc8335b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-7abacb6d-0528-45af-8342-3931afc8335b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Deleting offline snapshot 7abacb6d-0528-45af-8342-3931afc8335b of volume 61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] snapshot_file for this snap is: volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08cc5b8-d84a-4fa6-b6ae-2b1b38eda8b0]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:19 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b Aug 20 06:50:19 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:19 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 1073741824" returned: 0 in 0.488s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:19 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 Aug 20 06:50:19 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:19 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b" returned: 0 in 0.443s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61009f01-0606-4271-92bb-16d87eb70927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:50:19 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[561736f3-55b7-40a5-9183-43c778b61984]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bb59d-032a-49c5-9899-eb58f8f8dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0eb9fa-ed27-4592-8e95-d60008827535', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c025a6-bd5b-4d76-83ab-d1e66a064069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-8d0eb9fa-ed27-4592-8e95-d60008827535 (8d0eb9fa-ed27-4592-8e95-d60008827535): created successfully Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c025a6-bd5b-4d76-83ab-d1e66a064069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (8fcbb027-d58f-4f63-8ce5-c76635002283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0a56aeea-13ab-4823-a4c9-24d9a99cd92f tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:19 devstack sudo[111462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 Aug 20 06:50:19 devstack sudo[111462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:19 devstack sudo[111462]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:19 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b Aug 20 06:50:19 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:20 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:20 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b Aug 20 06:50:20 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:20 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927.7abacb6d-0528-45af-8342-3931afc8335b" returned: 0 in 0.236s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-7abacb6d-0528-45af-8342-3931afc8335b" released by "_delete_snapshot" :: held 1.508s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" released by "delete_snapshot" :: held 1.533s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Created reservations ['27b8ae3b-8212-46c1-8db3-c8024b0d0005', 'dd816ace-ac4d-438c-869e-7bd394e97ee3', '1c786300-ed4e-491b-bfe7-d2282adc14e9', '7e0759fc-5736-43b9-b7c1-bd4ad667026f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Delete snapshot completed successfully. Aug 20 06:50:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5f8ae486-e212-4d43-a4dd-c2df62833260 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-7abacb6d-0528-45af-8342-3931afc8335b-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (7bea9d41-0b72-4941-979f-f3e61f56ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c0eeb7-cd54-4d77-80ce-0b3178fd2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-61009f01-0606-4271-92bb-16d87eb70927-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c0eeb7-cd54-4d77-80ce-0b3178fd2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198309517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9a43fd-19e2-4b74-8484-5f8292716e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:21Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85610467-0e43-4a97-81ce-7d6c40e1fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85610467-0e43-4a97-81ce-7d6c40e1fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04446fcb-1e8f-4372-9788-eb745af48ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04446fcb-1e8f-4372-9788-eb745af48ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9a43fd-19e2-4b74-8484-5f8292716e3d', 'volume_name': 'volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ea924a-eb7d-444a-ada0-2886b67fb669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ea924a-eb7d-444a-ada0-2886b67fb669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1490090-b0c7-4eeb-aa9a-5f192fea4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume 8d9a43fd-19e2-4b74-8484-5f8292716e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d', 'volume_size': 1} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198309517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9a43fd-19e2-4b74-8484-5f8292716e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:21Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume 8d9a43fd-19e2-4b74-8484-5f8292716e3d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:21 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-61009f01-0606-4271-92bb-16d87eb70927-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:21 devstack sudo[111476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d 1073741824 Aug 20 06:50:21 devstack sudo[111476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[68741691-e918-4425-bd43-2ae0d2b8b84a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (bbca836d-45f2-4825-84df-13b2f9b35fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0d1e20-87cb-440f-9284-d553649fec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0d1e20-87cb-440f-9284-d553649fec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485789517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74284616-44f6-4947-89cb-4299a3198680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:21Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085bacca-f042-4de1-97e4-37c3966511b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 Aug 20 06:50:21 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085bacca-f042-4de1-97e4-37c3966511b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17262f3-20ff-4fd4-a272-02cad7e2eab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17262f3-20ff-4fd4-a272-02cad7e2eab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74284616-44f6-4947-89cb-4299a3198680', 'volume_name': 'volume-74284616-44f6-4947-89cb-4299a3198680', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792df137-354a-4a02-900b-38d37b549b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792df137-354a-4a02-900b-38d37b549b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfb75db-3e25-436b-add4-e2f48a589d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:21 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume 74284616-44f6-4947-89cb-4299a3198680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74284616-44f6-4947-89cb-4299a3198680', 'volume_size': 1} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:21 devstack sudo[111476]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d 1073741824" returned: 0 in 0.607s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (749255b9-efd6-48a4-9910-ffbac222caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e08ead-e30f-4161-baa5-2f37391e3799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e08ead-e30f-4161-baa5-2f37391e3799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077741511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440636c-e8a3-49c5-806c-d68d013797dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:22Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f1d912-90b4-4875-b66b-fd90e2b41120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f1d912-90b4-4875-b66b-fd90e2b41120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c88603-4d5e-43d5-931f-ed964fece0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c88603-4d5e-43d5-931f-ed964fece0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0440636c-e8a3-49c5-806c-d68d013797dc', 'volume_name': 'volume-0440636c-e8a3-49c5-806c-d68d013797dc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84037b2-065c-4049-8f40-7206fc810dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84037b2-065c-4049-8f40-7206fc810dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eef8578-0c31-4850-b25f-f9b4ce3118fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume 0440636c-e8a3-49c5-806c-d68d013797dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0440636c-e8a3-49c5-806c-d68d013797dc', 'volume_size': 1} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:22 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927" returned: 0 in 0.546s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:22 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927 Aug 20 06:50:22 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:22 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d Aug 20 06:50:22 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (ee3b2dec-6cc3-44cc-a6e4-a19ed1607dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:22 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f177c98a-3e6d-4675-ae69-2f3655cc107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-61009f01-0606-4271-92bb-16d87eb70927" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f177c98a-3e6d-4675-ae69-2f3655cc107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819578075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5712398f-27c1-4f1d-bef0-8a8d37918090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:22Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b0ab65-9f12-42e1-9285-2af26174fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b0ab65-9f12-42e1-9285-2af26174fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee31df5-63bb-45fd-8275-e12b7772c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee31df5-63bb-45fd-8275-e12b7772c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5712398f-27c1-4f1d-bef0-8a8d37918090', 'volume_name': 'volume-5712398f-27c1-4f1d-bef0-8a8d37918090', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4719af8e-e994-40a7-98f7-f6df0fae7501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4719af8e-e994-40a7-98f7-f6df0fae7501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f956de-c8e4-4b6c-9f60-2e594e84a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume 5712398f-27c1-4f1d-bef0-8a8d37918090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5712398f-27c1-4f1d-bef0-8a8d37918090', 'volume_size': 1} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-61009f01-0606-4271-92bb-16d87eb70927" released by "delete_volume" :: held 1.069s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d" returned: 0 in 0.423s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485789517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74284616-44f6-4947-89cb-4299a3198680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:21Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume 74284616-44f6-4947-89cb-4299a3198680 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1490090-b0c7-4eeb-aa9a-5f192fea4c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7583f470-e128-48d8-9d81-cdc5393ce653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack sudo[111493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 1073741824 Aug 20 06:50:22 devstack sudo[111493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d (8d9a43fd-19e2-4b74-8484-5f8292716e3d): created successfully Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7583f470-e128-48d8-9d81-cdc5393ce653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (7bea9d41-0b72-4941-979f-f3e61f56ad00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9368d6c9-27df-4161-97ad-3d37b4bec555 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Created reservations ['cc3a02a9-6898-43f0-8c16-86c892f23961', 'a84c640c-3f43-4fea-8393-ec24adedebda', '52f5a746-e611-4a63-ac9a-4691f9b0b001', 'e0bc4ad1-7da4-44fb-8e18-4c0f2989babd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:22 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:22 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (e29f8954-b60c-4d92-894e-84869dc664a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a794190-3a45-4525-8acb-09cace677e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a794190-3a45-4525-8acb-09cace677e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561452413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44953c6-ca69-4958-bb66-424358ffc8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:23Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0e69bd-5e7e-4636-8be3-213eb5f7a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0e69bd-5e7e-4636-8be3-213eb5f7a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a012de97-cb17-43e4-8756-a439b2e0af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a012de97-cb17-43e4-8756-a439b2e0af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44953c6-ca69-4958-bb66-424358ffc8e0', 'volume_name': 'volume-f44953c6-ca69-4958-bb66-424358ffc8e0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c446dc-f846-4603-90f7-44f00062dd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c446dc-f846-4603-90f7-44f00062dd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf883da-8bc7-42e2-8905-9db83a72658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume f44953c6-ca69-4958-bb66-424358ffc8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44953c6-ca69-4958-bb66-424358ffc8e0', 'volume_size': 1} Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:22 devstack sudo[111493]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 1073741824" returned: 0 in 0.485s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:23 devstack sudo[111502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 Aug 20 06:50:23 devstack sudo[111502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:23 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.331s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Deleted volume successfully. Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e9eab61b-f57d-4eb5-9249-2c980aec0cb5 tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-61009f01-0606-4271-92bb-16d87eb70927-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:23 devstack sudo[111502]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680" returned: 0 in 0.276s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077741511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440636c-e8a3-49c5-806c-d68d013797dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:22Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume 0440636c-e8a3-49c5-806c-d68d013797dc {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:23 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfb75db-3e25-436b-add4-e2f48a589d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74284616-44f6-4947-89cb-4299a3198680', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:23 devstack sudo[111505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc 1073741824 Aug 20 06:50:23 devstack sudo[111505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad327fc-2db1-4c09-abeb-d9223c781d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-74284616-44f6-4947-89cb-4299a3198680 (74284616-44f6-4947-89cb-4299a3198680): created successfully Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad327fc-2db1-4c09-abeb-d9223c781d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (bbca836d-45f2-4825-84df-13b2f9b35fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3b7908b6-b03f-4350-8f13-19574096b659 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-9050025b-0c74-44c4-9c42-017d2373612d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-9050025b-0c74-44c4-9c42-017d2373612d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "cinder-quobyte-9050025b-0c74-44c4-9c42-017d2373612d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-9050025b-0c74-44c4-9c42-017d2373612d" acquired by "delete_volume" :: waited 0.013s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc595b-ebdf-4def-b157-9701496ab343]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:23 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d Aug 20 06:50:23 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:23 devstack sudo[111505]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc 1073741824" returned: 0 in 0.475s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:23 devstack sudo[111512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc Aug 20 06:50:23 devstack sudo[111512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:24 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d" returned: 0 in 0.437s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:24 devstack sudo[111517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d Aug 20 06:50:24 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:24 devstack sudo[111512]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819578075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5712398f-27c1-4f1d-bef0-8a8d37918090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:22Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume 5712398f-27c1-4f1d-bef0-8a8d37918090 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eef8578-0c31-4850-b25f-f9b4ce3118fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0440636c-e8a3-49c5-806c-d68d013797dc', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcb8371-9670-45b4-87c6-1dd4d739d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:24 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 1073741824 Aug 20 06:50:24 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-0440636c-e8a3-49c5-806c-d68d013797dc (0440636c-e8a3-49c5-806c-d68d013797dc): created successfully Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcb8371-9670-45b4-87c6-1dd4d739d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (749255b9-efd6-48a4-9910-ffbac222caee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bbd7e6d2-dcbe-4478-90bf-c6fe6f2133a9 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:24 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-9050025b-0c74-44c4-9c42-017d2373612d" returned: 0 in 0.299s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-quobyte-9050025b-0c74-44c4-9c42-017d2373612d" released by "delete_volume" :: held 0.777s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Created reservations ['cf7ad03b-44fd-492a-ae1c-09029ffc82dc', 'd8d1cd99-a09a-4e8e-913d-7e84bb27399c', 'd6be98ee-8546-4085-b375-bc3999b53197', 'aedf2989-27ca-4d2f-95fd-131dde81759d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:24 devstack sudo[111526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:24 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:24 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 1073741824" returned: 0 in 0.535s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:24 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 Aug 20 06:50:24 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:24 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.271s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Deleted volume successfully. Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4d239b29-881c-4648-b237-698b748bf9fa tempest-CinderUnicodeTest-2140489304 None] Lock "cinder-9050025b-0c74-44c4-9c42-017d2373612d-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:24 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561452413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44953c6-ca69-4958-bb66-424358ffc8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe864d59df44cfcb0864745ebc79a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:23Z,use_quota=True,user_id='9323cb43dff548468d3acf65c77b4c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Creating volume f44953c6-ca69-4958-bb66-424358ffc8e0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f956de-c8e4-4b6c-9f60-2e594e84a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5712398f-27c1-4f1d-bef0-8a8d37918090', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0e6c4e-bc8c-49eb-b6cd-806f550bb067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:25 devstack sudo[111533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 1073741824 Aug 20 06:50:25 devstack sudo[111533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-5712398f-27c1-4f1d-bef0-8a8d37918090 (5712398f-27c1-4f1d-bef0-8a8d37918090): created successfully Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0e6c4e-bc8c-49eb-b6cd-806f550bb067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (ee3b2dec-6cc3-44cc-a6e4-a19ed1607dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-62e56c4e-1555-41e9-847d-c3a6ed96f730 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:25 devstack sudo[111533]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 1073741824" returned: 0 in 0.517s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:25 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 Aug 20 06:50:25 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:25 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0" returned: 0 in 0.269s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf883da-8bc7-42e2-8905-9db83a72658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44953c6-ca69-4958-bb66-424358ffc8e0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bdf596-f851-4bd0-b9d9-e2b5d0823149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Volume volume-f44953c6-ca69-4958-bb66-424358ffc8e0 (f44953c6-ca69-4958-bb66-424358ffc8e0): created successfully Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bdf596-f851-4bd0-b9d9-e2b5d0823149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Flow 'volume_create_manager' (e29f8954-b60c-4d92-894e-84869dc664a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c6be286f-0437-4208-b30d-67e9362080bc tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created volume successfully. Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-f44953c6-ca69-4958-bb66-424358ffc8e0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-f44953c6-ca69-4958-bb66-424358ffc8e0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-f44953c6-ca69-4958-bb66-424358ffc8e0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-f44953c6-ca69-4958-bb66-424358ffc8e0" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59400f-09a9-4288-a38f-cb5224a19f7e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:26 devstack sudo[111542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 Aug 20 06:50:26 devstack sudo[111542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:27 devstack sudo[111542]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0" returned: 0 in 0.472s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:27 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0 Aug 20 06:50:27 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:27 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-f44953c6-ca69-4958-bb66-424358ffc8e0" returned: 0 in 0.274s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-f44953c6-ca69-4958-bb66-424358ffc8e0" released by "delete_volume" :: held 0.811s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['e27fc812-625d-4ca3-bee6-7bec9481385e', '7b22b027-bcbd-4c73-9169-d10b7975fd8b', '2e5c6ea7-0871-4650-97d7-3471710b44c9', '9c489695-dfe7-4a4c-bb30-a503ca43b927'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:27 devstack sudo[111552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:27 devstack sudo[111552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-5712398f-27c1-4f1d-bef0-8a8d37918090-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-5712398f-27c1-4f1d-bef0-8a8d37918090-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-5712398f-27c1-4f1d-bef0-8a8d37918090" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-5712398f-27c1-4f1d-bef0-8a8d37918090" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[75582cc1-5ef4-4248-bed8-aca8c4e16f76]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:28 devstack sudo[111552]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.454s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:28 devstack sudo[111557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 Aug 20 06:50:28 devstack sudo[111557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-578858f4-d91e-4039-bf71-c6c03aaf7a9c tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-f44953c6-ca69-4958-bb66-424358ffc8e0-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:28 devstack sudo[111557]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090" returned: 0 in 0.428s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:28 devstack sudo[111563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090 Aug 20 06:50:28 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:28 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5712398f-27c1-4f1d-bef0-8a8d37918090" returned: 0 in 0.324s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-5712398f-27c1-4f1d-bef0-8a8d37918090" released by "delete_volume" :: held 0.823s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=157,cinder:UPDATE=213,cinder:INSERT=53,cinder:DELETE=18 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=170,cinder:UPDATE=225,cinder:DELETE=21,cinder:INSERT=49 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['805169bd-babe-4706-b284-6257e5b92b30', '6cacee3f-e7f2-4490-986a-8d7bfd8ce76d', 'ecec4abe-4d10-4d93-b7a6-d40d164a94c5', 'e2d30fda-b1ab-4959-b9ce-4e83b697fcef'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Flow 'volume_create_manager' (ca72f3ad-93ff-4b51-ae3e-121705c86357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae76d7-c05b-4b09-994c-a74c13836897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae76d7-c05b-4b09-994c-a74c13836897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213859758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70650538-9704-47b8-b2fd-47301f7c26b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982a57343d4ca4ac78a195dc48377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:29Z,use_quota=True,user_id='8353d8053126451fb9065f4246f68a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5413efdb-dbcf-4415-965a-8798d9978b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5413efdb-dbcf-4415-965a-8798d9978b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77929cb2-b754-47b9-9336-5d42bd98ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77929cb2-b754-47b9-9336-5d42bd98ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70650538-9704-47b8-b2fd-47301f7c26b6', 'volume_name': 'volume-70650538-9704-47b8-b2fd-47301f7c26b6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc0e046-34c0-4fa2-b54f-9ea7181a672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc0e046-34c0-4fa2-b54f-9ea7181a672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbe84f8-1cb6-47f6-bda1-3a75def9ae0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Volume 70650538-9704-47b8-b2fd-47301f7c26b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70650538-9704-47b8-b2fd-47301f7c26b6', 'volume_size': 1} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213859758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70650538-9704-47b8-b2fd-47301f7c26b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982a57343d4ca4ac78a195dc48377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:29Z,use_quota=True,user_id='8353d8053126451fb9065f4246f68a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Creating volume 70650538-9704-47b8-b2fd-47301f7c26b6 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:28 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:29 devstack sudo[111567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 1073741824 Aug 20 06:50:29 devstack sudo[111567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:29 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:29 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:29 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.270s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-4c507664-5ce3-4e43-a43f-f61d4c2e3ad2 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-5712398f-27c1-4f1d-bef0-8a8d37918090-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:29 devstack sudo[111567]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 1073741824" returned: 0 in 0.620s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:29 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 Aug 20 06:50:29 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:29 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbe84f8-1cb6-47f6-bda1-3a75def9ae0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70650538-9704-47b8-b2fd-47301f7c26b6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88faea1-005e-4012-a55c-1d6cbe8456e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:29 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Volume volume-70650538-9704-47b8-b2fd-47301f7c26b6 (70650538-9704-47b8-b2fd-47301f7c26b6): created successfully Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88faea1-005e-4012-a55c-1d6cbe8456e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Flow 'volume_create_manager' (ca72f3ad-93ff-4b51-ae3e-121705c86357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-606936dd-b8bb-4aca-a971-2302503a2b7e tempest-ProjectReaderTests-2034935000 None] Created volume successfully. Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-0440636c-e8a3-49c5-806c-d68d013797dc-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-0440636c-e8a3-49c5-806c-d68d013797dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-0440636c-e8a3-49c5-806c-d68d013797dc" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-0440636c-e8a3-49c5-806c-d68d013797dc" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25ceac-4efe-419e-8523-0ccdd5532ecf]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:30 devstack sudo[111579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc Aug 20 06:50:30 devstack sudo[111579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:30 devstack sudo[111579]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc" returned: 0 in 0.478s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:30 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc Aug 20 06:50:30 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:31 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0440636c-e8a3-49c5-806c-d68d013797dc" returned: 0 in 0.319s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-0440636c-e8a3-49c5-806c-d68d013797dc" released by "delete_volume" :: held 0.871s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Acquiring lock "cinder-70650538-9704-47b8-b2fd-47301f7c26b6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "cinder-70650538-9704-47b8-b2fd-47301f7c26b6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['3b50c83d-1596-475d-9307-e4127342885c', '23665e58-820f-4445-9973-7d6600044913', '56767063-7a67-4b87-b3c7-5e493c968eba', '4eff94b0-9eb1-42ad-aef2-846d41c63597'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-e216c2d7-378b-4fd0-be86-33192f7101d6 req-2884a5bc-86d5-4397-879f-d1e6379c0600 tempest-TestMinimumBasicScenario-1320074261 None] Terminate volume connection completed successfully. Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-e216c2d7-378b-4fd0-be86-33192f7101d6 req-2884a5bc-86d5-4397-879f-d1e6379c0600 tempest-TestMinimumBasicScenario-1320074261 None] Deleting attachment aecbaf38-876c-4bbb-825b-8986f0414082. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Acquiring lock "cinder-quobyte-70650538-9704-47b8-b2fd-47301f7c26b6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "cinder-quobyte-70650538-9704-47b8-b2fd-47301f7c26b6" acquired by "delete_volume" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b28685-020a-429a-8e07-2ecb51e831f9]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:31 devstack sudo[111596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:31 devstack sudo[111596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:31 devstack sudo[111595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 Aug 20 06:50:31 devstack sudo[111595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:31 devstack sudo[111596]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.282s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-85be3531-f5b0-47f6-bff5-8947976100b5 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-0440636c-e8a3-49c5-806c-d68d013797dc-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:31 devstack sudo[111595]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:31 devstack sudo[111603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6 Aug 20 06:50:31 devstack sudo[111603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "cinder-d9d8d61d-0c9c-4eee-b110-9df8542b5921-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "cinder-d9d8d61d-0c9c-4eee-b110-9df8542b5921-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "cinder-quobyte-d9d8d61d-0c9c-4eee-b110-9df8542b5921" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "cinder-quobyte-d9d8d61d-0c9c-4eee-b110-9df8542b5921" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ea1c0-e54e-4c5e-8421-5e283e80da3c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:32 devstack sudo[111603]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-70650538-9704-47b8-b2fd-47301f7c26b6" returned: 0 in 0.267s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "cinder-quobyte-70650538-9704-47b8-b2fd-47301f7c26b6" released by "delete_volume" :: held 0.767s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:32 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 Aug 20 06:50:32 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Created reservations ['ee42dd7d-f241-4e33-9451-6282b6f64aa0', 'b8ff9e35-bdae-4219-8c59-6498ce6e9006', '71e61d96-5c39-4799-ae9c-2543852598ea', 'cead0e9b-b436-4e16-bc72-4c650348b4dd'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:32 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:32 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:32 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921" returned: 0 in 0.410s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-74284616-44f6-4947-89cb-4299a3198680-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:32 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921 Aug 20 06:50:32 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-74284616-44f6-4947-89cb-4299a3198680-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-74284616-44f6-4947-89cb-4299a3198680" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-74284616-44f6-4947-89cb-4299a3198680" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:32 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Deleted volume successfully. Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf495d40-5a3f-44bb-8420-ed3c18c15038]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e805e1ee-d848-45f4-b164-be0fa79d2992 tempest-ProjectReaderTests-2034935000 None] Lock "cinder-70650538-9704-47b8-b2fd-47301f7c26b6-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:32 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 Aug 20 06:50:32 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:32 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d9d8d61d-0c9c-4eee-b110-9df8542b5921" returned: 0 in 0.346s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "cinder-quobyte-d9d8d61d-0c9c-4eee-b110-9df8542b5921" released by "delete_volume" :: held 0.804s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Created reservations ['15bb801c-1fbb-49e3-861e-d53bf73549e5', '384edea6-6dc3-4215-95bd-34197bc62054', 'adff3c52-bafc-4d25-9f4f-3228432dbf50', '46e7f7f5-28fc-4288-9659-b94c4064d3ca'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:32 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:32 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Flow 'volume_create_manager' (6cd713ff-6ded-4b67-b9b5-78db99a99a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd8b51c-54a5-46ff-b1e9-aca3413fcbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:32 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd8b51c-54a5-46ff-b1e9-aca3413fcbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255692652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501e8746-8b64-4da8-b44a-0e1d731a6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982a57343d4ca4ac78a195dc48377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:33Z,use_quota=True,user_id='8353d8053126451fb9065f4246f68a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42800313-2575-4891-877e-44d69a04551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42800313-2575-4891-877e-44d69a04551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfddfab1-a86a-430d-aab7-8db1ddba4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfddfab1-a86a-430d-aab7-8db1ddba4acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501e8746-8b64-4da8-b44a-0e1d731a6a66', 'volume_name': 'volume-501e8746-8b64-4da8-b44a-0e1d731a6a66', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3640ff05-6f61-4618-af6b-a929189603f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3640ff05-6f61-4618-af6b-a929189603f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0214a35-0919-4dd8-8e0a-d857daf77d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:33 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Volume 501e8746-8b64-4da8-b44a-0e1d731a6a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501e8746-8b64-4da8-b44a-0e1d731a6a66', 'volume_size': 1} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255692652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501e8746-8b64-4da8-b44a-0e1d731a6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982a57343d4ca4ac78a195dc48377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:33Z,use_quota=True,user_id='8353d8053126451fb9065f4246f68a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Creating volume 501e8746-8b64-4da8-b44a-0e1d731a6a66 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:33 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680" returned: 0 in 0.479s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:33 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 1073741824 Aug 20 06:50:33 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:33 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680 Aug 20 06:50:33 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:33 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.296s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Deleted volume successfully. Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-389e5d9d-1ea9-40ff-8b42-3f5a9f803fc1 tempest-TestMinimumBasicScenario-1320074261 None] Lock "cinder-d9d8d61d-0c9c-4eee-b110-9df8542b5921-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:33 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-74284616-44f6-4947-89cb-4299a3198680" returned: 0 in 0.363s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-74284616-44f6-4947-89cb-4299a3198680" released by "delete_volume" :: held 0.909s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['e0d278e5-22bb-4d2a-9ba5-aafefa50753d', 'aa9f18e2-c6f1-4634-9413-dd9df669b1bd', 'b4633504-337a-4201-afcf-9bc107b18454', '3eb40537-2596-477c-94e3-cd96f50dbf90'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:33 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:33 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-8d9a43fd-19e2-4b74-8484-5f8292716e3d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:33 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 1073741824" returned: 0 in 0.617s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-8d9a43fd-19e2-4b74-8484-5f8292716e3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-8d9a43fd-19e2-4b74-8484-5f8292716e3d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-8d9a43fd-19e2-4b74-8484-5f8292716e3d" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:33 devstack sudo[111645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 Aug 20 06:50:33 devstack sudo[111645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733b624-45a9-4ca5-91d5-4b26f2eb4850]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:34 devstack sudo[111652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d Aug 20 06:50:34 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:34 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.500s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d1dfe825-1d9c-47f9-8390-d405aa092a22 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-74284616-44f6-4947-89cb-4299a3198680-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:34 devstack sudo[111645]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66" returned: 0 in 0.514s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0214a35-0919-4dd8-8e0a-d857daf77d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501e8746-8b64-4da8-b44a-0e1d731a6a66', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f17982-595b-4bc4-a7ff-c8f92df23514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:34 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Volume volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 (501e8746-8b64-4da8-b44a-0e1d731a6a66): created successfully Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f17982-595b-4bc4-a7ff-c8f92df23514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Flow 'volume_create_manager' (6cd713ff-6ded-4b67-b9b5-78db99a99a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bbc495a3-926e-4c66-837d-342aa926aa3e tempest-ProjectReaderTests-2034935000 None] Created volume successfully. Aug 20 06:50:34 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d" returned: 0 in 0.537s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:34 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d Aug 20 06:50:34 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:34 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:34 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:34 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d9a43fd-19e2-4b74-8484-5f8292716e3d" returned: 0 in 0.303s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-8d9a43fd-19e2-4b74-8484-5f8292716e3d" released by "delete_volume" :: held 0.918s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['ae2a0b36-848c-4fd1-aa5f-9e72a4a2bfcb', '54d47522-e618-4229-8366-d76a9160cd05', 'c8bd7177-a598-486f-ac98-b712a31ae27a', '609db86f-4fa1-4433-b8df-1b56ca8b09b6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:34 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:34 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:34 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-8d0eb9fa-ed27-4592-8e95-d60008827535-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-8d0eb9fa-ed27-4592-8e95-d60008827535-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "cinder-quobyte-8d0eb9fa-ed27-4592-8e95-d60008827535" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-8d0eb9fa-ed27-4592-8e95-d60008827535" acquired by "delete_volume" :: waited 0.052s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede849da-af5b-4fab-8aa5-e80623f28e08]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:35 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Acquiring lock "cinder-501e8746-8b64-4da8-b44a-0e1d731a6a66-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:35 devstack sudo[111681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 Aug 20 06:50:35 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.518s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "cinder-501e8746-8b64-4da8-b44a-0e1d731a6a66-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18f79065-4415-4caf-bb2c-663f0d494637 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-8d9a43fd-19e2-4b74-8484-5f8292716e3d-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Acquiring lock "cinder-quobyte-501e8746-8b64-4da8-b44a-0e1d731a6a66" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "cinder-quobyte-501e8746-8b64-4da8-b44a-0e1d731a6a66" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[24759ece-756e-46aa-80fa-e0944d1fe447]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:35 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 Aug 20 06:50:35 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:35 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535" returned: 0 in 0.514s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:35 devstack sudo[111690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535 Aug 20 06:50:35 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:35 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66" returned: 0 in 0.424s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:35 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66 Aug 20 06:50:35 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:35 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-8d0eb9fa-ed27-4592-8e95-d60008827535" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-quobyte-8d0eb9fa-ed27-4592-8e95-d60008827535" released by "delete_volume" :: held 0.871s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Created reservations ['f0e889b7-fba2-4652-b0f9-89b7f99a14b1', '32ed1c44-ebc0-4182-b729-91cab599897e', '97029b83-7f34-4b94-90c6-05a194bf2258', '35a7125f-8a30-48d7-8b96-c6fdfe7ab723'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:36 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:36 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:36 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-501e8746-8b64-4da8-b44a-0e1d731a6a66" returned: 0 in 0.302s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "cinder-quobyte-501e8746-8b64-4da8-b44a-0e1d731a6a66" released by "delete_volume" :: held 0.784s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Created reservations ['3c90b78e-b2a9-40f6-9366-0edd80ffcdfe', 'b07a897b-d810-4d35-b408-5e30e5a5ecdf', 'ba97987e-e741-4b32-849f-e31b6cde5a8b', 'c6696991-b07c-414e-8e2e-d3ff91cd7ba6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:36 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:36 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:36 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.366s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Deleted volume successfully. Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06f2631a-79d8-44be-918c-73534b7ec665 tempest-CreateVolumesFromSourceVolumeTest-2043028058 None] Lock "cinder-8d0eb9fa-ed27-4592-8e95-d60008827535-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:36 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.330s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Deleted volume successfully. Aug 20 06:50:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bb2f0691-2516-472e-9d35-cbc88cb6d90d tempest-ProjectReaderTests-2034935000 None] Lock "cinder-501e8746-8b64-4da8-b44a-0e1d731a6a66-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Flow 'volume_create_manager' (006342a2-f80d-495c-a02d-951d73806b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac220cd0-f941-4304-acae-58fa6a7c4ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac220cd0-f941-4304-acae-58fa6a7c4ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-631920461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dc17f7-b07e-464a-9c26-e62854cb9d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358304cf242343e4ba9d405a40d7664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:40Z,use_quota=True,user_id='4f82cd5ca64b4cd2a36a6f50d4abe611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37fe696-f670-4619-bd65-ac0fd25d38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37fe696-f670-4619-bd65-ac0fd25d38af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3190e3-2b13-4d77-b86a-0e0fa6487571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3190e3-2b13-4d77-b86a-0e0fa6487571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4dc17f7-b07e-464a-9c26-e62854cb9d6d', 'volume_name': 'volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ef444a-c188-49ed-aad1-fa7be18ffd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ef444a-c188-49ed-aad1-fa7be18ffd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b666991b-7fbf-43e5-a708-7773fdae13af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Volume b4dc17f7-b07e-464a-9c26-e62854cb9d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d', 'volume_size': 1} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-631920461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dc17f7-b07e-464a-9c26-e62854cb9d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358304cf242343e4ba9d405a40d7664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:40Z,use_quota=True,user_id='4f82cd5ca64b4cd2a36a6f50d4abe611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Creating volume b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:40 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:40 devstack sudo[111707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d 1073741824 Aug 20 06:50:40 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:41 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d 1073741824" returned: 0 in 0.508s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:41 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:41 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.386s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:41 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b666991b-7fbf-43e5-a708-7773fdae13af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df050e1b-15e7-4b39-af11-a9c08cefbb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Volume volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d (b4dc17f7-b07e-464a-9c26-e62854cb9d6d): created successfully Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df050e1b-15e7-4b39-af11-a9c08cefbb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Flow 'volume_create_manager' (006342a2-f80d-495c-a02d-951d73806b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f80b30ac-733d-4ef0-b556-ff86c7ec317b tempest-VolumeDependencyTests-798757794 None] Created volume successfully. Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (7ea502c1-1500-4e7f-99a5-20b2eb5ccdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789114d8-42d2-4450-88eb-61143d1a5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789114d8-42d2-4450-88eb-61143d1a5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700666204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015a4838-f0ba-4517-afaf-1db59db58296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:42Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa2fc8a-47f8-4870-ab9b-d2266435124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa2fc8a-47f8-4870-ab9b-d2266435124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5813d6-2dd6-4590-bc0c-146e4f602765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5813d6-2dd6-4590-bc0c-146e4f602765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015a4838-f0ba-4517-afaf-1db59db58296', 'volume_name': 'volume-015a4838-f0ba-4517-afaf-1db59db58296', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd799ec8-b275-4f8c-af4a-d4eb48e27fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd799ec8-b275-4f8c-af4a-d4eb48e27fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5461c096-3dce-4187-85fe-82d998fd87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Volume 015a4838-f0ba-4517-afaf-1db59db58296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015a4838-f0ba-4517-afaf-1db59db58296', 'volume_size': 1} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700666204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015a4838-f0ba-4517-afaf-1db59db58296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:42Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Creating volume 015a4838-f0ba-4517-afaf-1db59db58296 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:41 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:42 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 1073741824 Aug 20 06:50:42 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:42 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 1073741824" returned: 0 in 0.459s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:42 devstack sudo[111723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 Aug 20 06:50:42 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:42 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5461c096-3dce-4187-85fe-82d998fd87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015a4838-f0ba-4517-afaf-1db59db58296', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503892c1-92ea-429a-99d7-6e64ba650ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Volume volume-015a4838-f0ba-4517-afaf-1db59db58296 (015a4838-f0ba-4517-afaf-1db59db58296): created successfully Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503892c1-92ea-429a-99d7-6e64ba650ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (7ea502c1-1500-4e7f-99a5-20b2eb5ccdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-338e464a-f190-474a-bb41-81bf0ec6b528 tempest-ProjectReaderTests-1493910417 None] Created volume successfully. Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Creating offline snapshot bea9579f-a2d9-42d3-9b61-f2c93784861e of volume b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c309f3-8968-42c5-b6ae-ff8190df1b90]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:43 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:43 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:43 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:43 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e 1G Aug 20 06:50:43 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:43 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e 1G" returned: 0 in 0.415s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:43 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:43 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.372s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e is being set with open permissions: ugo+rw Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:44 devstack sudo[111748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:44 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-015a4838-f0ba-4517-afaf-1db59db58296-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-015a4838-f0ba-4517-afaf-1db59db58296-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-quobyte-015a4838-f0ba-4517-afaf-1db59db58296" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-015a4838-f0ba-4517-afaf-1db59db58296" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ebee68-330e-4f7d-b8ef-d741fc5914e5]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:44 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:44 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info Aug 20 06:50:44 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack sudo[111750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 Aug 20 06:50:44 devstack sudo[111750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info is being set with open permissions: ugo+rw Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:44 devstack sudo[111759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info Aug 20 06:50:44 devstack sudo[111759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack sudo[111750]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296" returned: 0 in 0.394s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:44 devstack sudo[111761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296 Aug 20 06:50:44 devstack sudo[111761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:44 devstack sudo[111759]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.info" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:44 devstack sudo[111761]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-015a4838-f0ba-4517-afaf-1db59db58296" returned: 0 in 0.271s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-abe02848-eb48-461b-b198-9dc530409df6 tempest-VolumeDependencyTests-798757794 None] Create snapshot completed successfully Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-015a4838-f0ba-4517-afaf-1db59db58296" released by "delete_volume" :: held 0.716s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Created reservations ['8edabbea-619b-4b89-8da9-11ced286925b', 'd71587f2-15f8-4289-b0bd-21548cf10cb4', '43ca0203-cc6d-45fc-9801-e2725646caba', '39107226-9cb7-47cc-a71d-19cf575c1bbc'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:45 devstack sudo[111765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:45 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:45 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.274s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Deleted volume successfully. Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a535b63-7493-4c9f-b02e-a146d865b1a7 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-015a4838-f0ba-4517-afaf-1db59db58296-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (1b997bdd-5170-41a3-937a-0cd1bcc54f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9380312b-1802-48b5-b9be-5b9641df4e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9380312b-1802-48b5-b9be-5b9641df4e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685487400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a71f6c-1ec9-4820-9645-f09a85d64330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:46Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ad2c9-7d46-4ff5-8f49-6e9f4aa97037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ad2c9-7d46-4ff5-8f49-6e9f4aa97037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498cab48-37e4-44e1-8fcc-a956c1225a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498cab48-37e4-44e1-8fcc-a956c1225a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a71f6c-1ec9-4820-9645-f09a85d64330', 'volume_name': 'volume-29a71f6c-1ec9-4820-9645-f09a85d64330', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f71ea92-0f6c-4625-b631-5ecf5a9362bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f71ea92-0f6c-4625-b631-5ecf5a9362bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692e0e58-fc50-4794-953b-672867e8754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Volume 29a71f6c-1ec9-4820-9645-f09a85d64330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a71f6c-1ec9-4820-9645-f09a85d64330', 'volume_size': 1} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685487400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a71f6c-1ec9-4820-9645-f09a85d64330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:46Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Creating volume 29a71f6c-1ec9-4820-9645-f09a85d64330 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:46 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:46 devstack sudo[111771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 1073741824 Aug 20 06:50:46 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:46 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 1073741824" returned: 0 in 0.612s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:46 devstack sudo[111778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 Aug 20 06:50:46 devstack sudo[111778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Flow 'volume_create_manager' (3df72a3f-fb35-4959-a988-99e5c739ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5008622e-7c8e-46be-b5b9-8e055574e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5008622e-7c8e-46be-b5b9-8e055574e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1053962063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358304cf242343e4ba9d405a40d7664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bea9579f-a2d9-42d3-9b61-f2c93784861e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:47Z,use_quota=True,user_id='4f82cd5ca64b4cd2a36a6f50d4abe611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4bab18-6a3f-442d-afb4-24ac37624b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4bab18-6a3f-442d-afb4-24ac37624b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58c373f-b438-48f4-add6-c3da11775391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58c373f-b438-48f4-add6-c3da11775391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529', 'volume_name': 'volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529', 'volume_size': 1, 'snapshot_id': 'bea9579f-a2d9-42d3-9b61-f2c93784861e'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfec852-c499-4828-9776-91a119847879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfec852-c499-4828-9776-91a119847879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b33b36-9e5a-46bf-a980-672758a769ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Volume 064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529', 'volume_size': 1, 'snapshot_id': 'bea9579f-a2d9-42d3-9b61-f2c93784861e'} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:46 devstack sudo[111778]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330" returned: 0 in 0.264s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.069s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692e0e58-fc50-4794-953b-672867e8754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a71f6c-1ec9-4820-9645-f09a85d64330', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab32f2f-3b4e-4628-8b2f-fe6aa794e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Creating volume 064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 from snapshot bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Volume volume-29a71f6c-1ec9-4820-9645-f09a85d64330 (29a71f6c-1ec9-4820-9645-f09a85d64330): created successfully Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab32f2f-3b4e-4628-8b2f-fe6aa794e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (1b997bdd-5170-41a3-937a-0cd1bcc54f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] snapshot: bea9579f-a2d9-42d3-9b61-f2c93784861e, volume: 064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:50:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3e9d6cec-d542-4441-b3cf-3f6dd9c99764 tempest-ProjectReaderTests-1493910417 None] Created volume successfully. Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85657bc-d938-405e-86f7-7c4ee8752ce7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:47 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:47 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:47 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.399s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[da065eb6-9fda-485d-a0fc-bf559b2f79ac]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:47 devstack sudo[111786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:47 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:47 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.395s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:50:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:47 devstack sudo[111792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 Aug 20 06:50:47 devstack sudo[111792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-29a71f6c-1ec9-4820-9645-f09a85d64330-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "cinder-29a71f6c-1ec9-4820-9645-f09a85d64330-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-quobyte-29a71f6c-1ec9-4820-9645-f09a85d64330" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-29a71f6c-1ec9-4820-9645-f09a85d64330" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be0d2d-908f-460e-93ac-9eb1e2608101]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:48 devstack sudo[111794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 Aug 20 06:50:48 devstack sudo[111794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:48 devstack sudo[111794]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330" returned: 0 in 0.655s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:48 devstack sudo[111809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330 Aug 20 06:50:48 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:49 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-29a71f6c-1ec9-4820-9645-f09a85d64330" returned: 0 in 0.572s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-29a71f6c-1ec9-4820-9645-f09a85d64330" released by "delete_volume" :: held 1.320s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Created reservations ['cb7c1fda-717a-4248-97d6-a9518d15cf18', '97b08b24-3bb9-4641-957c-8ee3322c5e7f', 'eeb81a5f-2458-4fac-bfcf-c6ba02989b19', '28c1f6ff-56b3-4539-b198-4a3dec44f27a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:50 devstack sudo[111812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:50 devstack sudo[111812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:50 devstack sudo[111812]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.753s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Deleted volume successfully. Aug 20 06:50:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-159ea4f2-a1c0-4eee-8606-4cb6b39d3a8b tempest-ProjectReaderTests-1493910417 None] Lock "cinder-29a71f6c-1ec9-4820-9645-f09a85d64330-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (7a0d2221-976e-498f-8e8c-638679b847e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b9ad7c-1355-4fd1-a7b6-3556d46d34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b9ad7c-1355-4fd1-a7b6-3556d46d34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8979228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec4e708-9ef1-4be2-a1c6-32f82ee3ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:52Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ea7999-2dc5-4995-b4aa-4a7d4567b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ea7999-2dc5-4995-b4aa-4a7d4567b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5652cd54-0472-4905-b655-608cd4f4de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5652cd54-0472-4905-b655-608cd4f4de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec4e708-9ef1-4be2-a1c6-32f82ee3ce46', 'volume_name': 'volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208736ea-17c1-4dbf-b14d-c84b31aa1a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208736ea-17c1-4dbf-b14d-c84b31aa1a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3432df0d-4ed4-4f81-88c0-88761ebc5437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Volume eec4e708-9ef1-4be2-a1c6-32f82ee3ce46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46', 'volume_size': 1} Aug 20 06:50:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:53 devstack sudo[111792]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" returned: 0 in 5.438s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:50:53 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Converted 1024.00 MB image at 188.27 MB/s Aug 20 06:50:53 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 is being set with open permissions: ugo+rw Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:53 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 Aug 20 06:50:53 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:53 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" released by "_copy_volume_from_snapshot" :: held 6.634s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" released by "_create_volume_from_snapshot" :: held 6.716s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.749s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8979228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec4e708-9ef1-4be2-a1c6-32f82ee3ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:52Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Creating volume eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:53 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:53 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 1073741824 Aug 20 06:50:53 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b33b36-9e5a-46bf-a980-672758a769ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529', 'volume_size': 1, 'snapshot_id': 'bea9579f-a2d9-42d3-9b61-f2c93784861e'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479df625-4d8a-4bcc-8648-571c05def8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Volume volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 (064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529): created successfully Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479df625-4d8a-4bcc-8648-571c05def8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Flow 'volume_create_manager' (3df72a3f-fb35-4959-a988-99e5c739ead2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c00fb174-1ecc-4e22-9176-5174baec43e1 tempest-VolumeDependencyTests-798757794 None] Created volume successfully. Aug 20 06:50:54 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 1073741824" returned: 0 in 0.441s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:54 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 Aug 20 06:50:54 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:54 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3432df0d-4ed4-4f81-88c0-88761ebc5437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a07b7f-b570-4ff8-b6d4-0933b3fe009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Volume volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 (eec4e708-9ef1-4be2-a1c6-32f82ee3ce46): created successfully Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a07b7f-b570-4ff8-b6d4-0933b3fe009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (7a0d2221-976e-498f-8e8c-638679b847e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0551a388-9e59-4b64-a762-7216d36b41c1 tempest-ProjectReaderTests-1493910417 None] Created volume successfully. Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-bea9579f-a2d9-42d3-9b61-f2c93784861e-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-bea9579f-a2d9-42d3-9b61-f2c93784861e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Deleting offline snapshot bea9579f-a2d9-42d3-9b61-f2c93784861e of volume b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] snapshot_file for this snap is: volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9a071-0d0d-415f-a4f4-65c0929bd3b9]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:54 devstack sudo[111830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:54 devstack sudo[111830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-quobyte-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:55 devstack sudo[111830]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[555efa39-9617-42d3-831f-1014d662e163]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2055b2d-a31d-4f6d-95b4-42b7ae95c946]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:55 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 Aug 20 06:50:55 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:55 devstack sudo[111850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:55 devstack sudo[111850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:55 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" returned: 0 in 0.453s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:55 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46 Aug 20 06:50:55 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:55 devstack sudo[111850]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.690s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:55 devstack sudo[111884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:55 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:55 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" returned: 0 in 0.295s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46" released by "delete_volume" :: held 0.822s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Created reservations ['d1d8e1fa-875d-4924-8856-258bba66f5d5', 'eabd7f91-8c41-479b-812f-ff8155eae120', 'dd29aede-4de9-4b70-a968-a619215bf518', '1c9c9fae-427a-475a-9899-4fff00f5d404'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:56 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:56 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:56 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.495s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:56 devstack sudo[111892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e Aug 20 06:50:56 devstack sudo[111892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:56 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.313s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Deleted volume successfully. Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-be03b6e9-da52-4354-b021-d01369bb99f9 tempest-ProjectReaderTests-1493910417 None] Lock "cinder-eec4e708-9ef1-4be2-a1c6-32f82ee3ce46-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:56 devstack sudo[111892]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d.bea9579f-a2d9-42d3-9b61-f2c93784861e" returned: 0 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-bea9579f-a2d9-42d3-9b61-f2c93784861e" released by "_delete_snapshot" :: held 2.034s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" released by "delete_snapshot" :: held 2.072s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (0c58613e-6538-4105-b5d2-4feb11936e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f09cd17-8ee1-48e7-b94e-3c0cb35ad924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f09cd17-8ee1-48e7-b94e-3c0cb35ad924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841364394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df42662e-1bcd-4279-8e20-7e55ca81be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:57Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411f57b0-7b15-4869-be67-5bd7c49246fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411f57b0-7b15-4869-be67-5bd7c49246fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c06e6c-3dc2-42d0-b9fc-7c3fa98e22d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c06e6c-3dc2-42d0-b9fc-7c3fa98e22d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df42662e-1bcd-4279-8e20-7e55ca81be14', 'volume_name': 'volume-df42662e-1bcd-4279-8e20-7e55ca81be14', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4106df96-1af8-4b82-bbf0-8ba5b6f52a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4106df96-1af8-4b82-bbf0-8ba5b6f52a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e547901f-61ad-4e3f-a958-e380d78b7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:56 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Volume df42662e-1bcd-4279-8e20-7e55ca81be14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df42662e-1bcd-4279-8e20-7e55ca81be14', 'volume_size': 1} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841364394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df42662e-1bcd-4279-8e20-7e55ca81be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b792d6c9c02c40b8b2b5eb822147f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:50:57Z,use_quota=True,user_id='89d817cf2e954aa8bb61e98188b16a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Creating volume df42662e-1bcd-4279-8e20-7e55ca81be14 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:50:56 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:56 devstack sudo[111895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 1073741824 Aug 20 06:50:56 devstack sudo[111895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Created reservations ['288ed798-a5bb-4cdf-9b8b-5a4ee9370232', 'c9694be4-4318-4fb5-99cc-773ca27708b1', '7c576d68-8413-468d-b659-7e1ecf450048', '6eb8e8a0-5293-4e0c-ab53-a74f6fe8f99e'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Delete snapshot completed successfully. Aug 20 06:50:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-54566036-39a4-4bc2-bb40-d476e5a0ca0d tempest-VolumeDependencyTests-798757794 None] Lock "cinder-bea9579f-a2d9-42d3-9b61-f2c93784861e-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:57 devstack sudo[111895]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 1073741824" returned: 0 in 0.620s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:57 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 Aug 20 06:50:57 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:57 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e547901f-61ad-4e3f-a958-e380d78b7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df42662e-1bcd-4279-8e20-7e55ca81be14', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07146f31-5651-439e-b4b8-e24daa589918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:50:57 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Volume volume-df42662e-1bcd-4279-8e20-7e55ca81be14 (df42662e-1bcd-4279-8e20-7e55ca81be14): created successfully Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07146f31-5651-439e-b4b8-e24daa589918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Flow 'volume_create_manager' (0c58613e-6538-4105-b5d2-4feb11936e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:50:57 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-18f5781b-c059-442a-97e0-033a6ad82979 tempest-ProjectReaderTests-1493910417 None] Created volume successfully. Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-b4dc17f7-b07e-464a-9c26-e62854cb9d6d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-b4dc17f7-b07e-464a-9c26-e62854cb9d6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1439a8-d37b-4096-847e-2213a62db52a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:58 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:58 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:58 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.387s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:58 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d Aug 20 06:50:58 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:58 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" returned: 0 in 0.251s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-b4dc17f7-b07e-464a-9c26-e62854cb9d6d" released by "delete_volume" :: held 0.709s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Created reservations ['f3d2d7a8-a542-4a6c-976e-40987a97d759', 'bc161167-22c6-4f44-bc0b-a3a50c67c149', '60ccc8c6-62b7-4510-bfcd-51d6d850dd8a', '3ca5b1f1-5b1b-4c82-9570-a47e4977cab3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:58 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:50:58 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-df42662e-1bcd-4279-8e20-7e55ca81be14-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "cinder-df42662e-1bcd-4279-8e20-7e55ca81be14-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Acquiring lock "cinder-quobyte-df42662e-1bcd-4279-8e20-7e55ca81be14" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-df42662e-1bcd-4279-8e20-7e55ca81be14" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28653d-f891-4b78-a2b9-7ed2d350167b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:59 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:50:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Deleted volume successfully. Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8a7233aa-b1fd-4910-96c7-f5d131714bd8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-b4dc17f7-b07e-464a-9c26-e62854cb9d6d-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:59 devstack sudo[111915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 Aug 20 06:50:59 devstack sudo[111915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[698588a5-b1bb-4af8-8c9f-3bd5f8d36600]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:59 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 Aug 20 06:50:59 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:59 devstack sudo[111915]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14" returned: 0 in 0.527s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:59 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14 Aug 20 06:50:59 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:59 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" returned: 0 in 0.441s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:50:59 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529 Aug 20 06:50:59 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:50:59 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df42662e-1bcd-4279-8e20-7e55ca81be14" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "cinder-quobyte-df42662e-1bcd-4279-8e20-7e55ca81be14" released by "delete_volume" :: held 0.887s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:50:59 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Created reservations ['27d04725-e264-4310-94f8-25a1b1f71dc1', '13068335-2b5f-4369-bc63-cc6accde4735', 'd9d211fa-9461-4def-9022-a9a90eac6852', 'd3641457-73d1-4ac1-a124-cb2a6d26318d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:51:00 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" returned: 0 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-quobyte-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529" released by "delete_volume" :: held 0.829s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:00 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:51:00 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Created reservations ['94bb42dc-0568-4a4d-bba2-77ba76f4fc00', 'cb0f4c84-8fa9-41f2-b151-efba87be48c7', 'ad67da40-0f67-415e-a403-b7311c159cc9', 'da454a1f-e1ec-472b-9c9a-5a32f6aa4dac'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:00 devstack sudo[111935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:51:00 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:00 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.401s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:51:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Deleted volume successfully. Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-0be81960-0672-4401-95e9-009121380a2e tempest-ProjectReaderTests-1493910417 None] Lock "cinder-df42662e-1bcd-4279-8e20-7e55ca81be14-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:00 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.428s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:51:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Deleted volume successfully. Aug 20 06:51:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1722270b-c316-49d9-b834-50bf1fe454a8 tempest-VolumeDependencyTests-798757794 None] Lock "cinder-064ed8a9-e6c5-48ff-8f9f-16ae1e4a8529-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Flow 'volume_create_manager' (9c3d9985-273a-4be5-a64e-e1de6953caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8859a5-ae54-47a0-b8a4-5347c5b5a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8859a5-ae54-47a0-b8a4-5347c5b5a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e8bc6e-b79a-422a-871b-3a1e127ec319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10788d04cec948fcb1b6a9248c82a1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:51:07Z,use_quota=True,user_id='d9d4d9711e9b48739b94719c80458e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca8139-aa7e-4901-9006-f4c5a8d241ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca8139-aa7e-4901-9006-f4c5a8d241ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296a566b-9439-4bdd-87e8-21a7eb7e3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296a566b-9439-4bdd-87e8-21a7eb7e3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1e8bc6e-b79a-422a-871b-3a1e127ec319', 'volume_name': 'volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319', 'volume_size': 1, 'image_id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ed11caaac3f3a6c9c6cc15b1c1cc28f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10788d04cec948fcb1b6a9248c82a1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afd24b1160e9282cdf8ef74c604cb0a451d3355358ca177c64c9aeb63ff25b5830e84eb3402ba41e8b7d7fc87d58bdaecbc44072ddecc3b79ac488dd3a881972', 'id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'created_at': datetime.datetime(2026, 8, 20, 4, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 51, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843f4b58-dfb5-4b15-80c2-638c834b7134/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf02f4e-70a3-4f7d-a2e4-def44e4a811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf02f4e-70a3-4f7d-a2e4-def44e4a811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a6b309-1a1e-4ac0-98f0-20106223747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Volume c1e8bc6e-b79a-422a-871b-3a1e127ec319: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319', 'volume_size': 1, 'image_id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ed11caaac3f3a6c9c6cc15b1c1cc28f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10788d04cec948fcb1b6a9248c82a1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afd24b1160e9282cdf8ef74c604cb0a451d3355358ca177c64c9aeb63ff25b5830e84eb3402ba41e8b7d7fc87d58bdaecbc44072ddecc3b79ac488dd3a881972', 'id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'created_at': datetime.datetime(2026, 8, 20, 4, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 51, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843f4b58-dfb5-4b15-80c2-638c834b7134/file', 'properties': {}}, 'image_service': } Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Trying to clone c1e8bc6e-b79a-422a-871b-3a1e127ec319 from image 843f4b58-dfb5-4b15-80c2-638c834b7134 at location (None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:51:07 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Image download 0.00 MB at 0.00 MB/s Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6de1e-f670-472c-9981-99fc65561032]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:07 devstack sudo[111945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:07 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:08 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:08 devstack sudo[111950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:08 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:08 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Temporary image 843f4b58-dfb5-4b15-80c2-638c834b7134 is fetched for user d9d4d9711e9b48739b94719c80458e2b. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[97edff6d-39f6-4a4e-b29b-9e5d5e0e0796]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:08 devstack sudo[111955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:08 devstack sudo[111955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:08 devstack sudo[111955]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:09 devstack sudo[111959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:09 devstack sudo[111959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:09 devstack sudo[111959]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e8bc6e-b79a-422a-871b-3a1e127ec319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10788d04cec948fcb1b6a9248c82a1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:51:07Z,use_quota=True,user_id='d9d4d9711e9b48739b94719c80458e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Creating volume c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:51:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:09 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1073741824 Aug 20 06:51:09 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:09 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1073741824" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:09 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 Aug 20 06:51:09 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:10 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Attempting download of 843f4b58-dfb5-4b15-80c2-638c834b7134 ((None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}])) to volume c1e8bc6e-b79a-422a-871b-3a1e127ec319. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5610b-0700-49e0-8417-fc4b7367c128]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:10 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk Aug 20 06:51:10 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:10 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk" returned: 0 in 0.408s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:10 devstack sudo[111976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk Aug 20 06:51:10 devstack sudo[111976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:10 devstack sudo[111976]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk" returned: 1 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843f4b58-dfb5-4b15-80c2-638c834b7134_9dzawnsk' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606e2e9-8356-40f2-ae65-ddec63f50268]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:10 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:10 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:11 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:11 devstack sudo[111985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD Aug 20 06:51:11 devstack sudo[111985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:11 devstack sudo[111985]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] 843f4b58-dfb5-4b15-80c2-638c834b7134 was raw, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:51:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:11 devstack sudo[111990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 Aug 20 06:51:11 devstack sudo[111990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:12 devstack sudo[111990]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319" returned: 0 in 0.541s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_843f4b58-dfb5-4b15-80c2-638c834b7134_p7wtskxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:51:12 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Converted 0.00 MB image at 0.00 MB/s Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:12 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1G Aug 20 06:51:12 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:12 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 1G" returned: 0 in 0.359s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Downloaded image 843f4b58-dfb5-4b15-80c2-638c834b7134 ((None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}])) to volume c1e8bc6e-b79a-422a-871b-3a1e127ec319 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Temporary image 843f4b58-dfb5-4b15-80c2-638c834b7134 for user d9d4d9711e9b48739b94719c80458e2b is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Marking volume c1e8bc6e-b79a-422a-871b-3a1e127ec319 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Copying metadata from image 843f4b58-dfb5-4b15-80c2-638c834b7134 to c1e8bc6e-b79a-422a-871b-3a1e127ec319. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Creating volume glance metadata for volume c1e8bc6e-b79a-422a-871b-3a1e127ec319 backed by image 843f4b58-dfb5-4b15-80c2-638c834b7134 with: {'image_id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ed11caaac3f3a6c9c6cc15b1c1cc28f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a6b309-1a1e-4ac0-98f0-20106223747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319', 'volume_size': 1, 'image_id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843f4b58-dfb5-4b15-80c2-638c834b7134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ed11caaac3f3a6c9c6cc15b1c1cc28f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10788d04cec948fcb1b6a9248c82a1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afd24b1160e9282cdf8ef74c604cb0a451d3355358ca177c64c9aeb63ff25b5830e84eb3402ba41e8b7d7fc87d58bdaecbc44072ddecc3b79ac488dd3a881972', 'id': '843f4b58-dfb5-4b15-80c2-638c834b7134', 'created_at': datetime.datetime(2026, 8, 20, 4, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 51, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843f4b58-dfb5-4b15-80c2-638c834b7134/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fb0fca-6c7b-4978-a7fb-47e14a0f9045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:12 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Volume volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 (c1e8bc6e-b79a-422a-871b-3a1e127ec319): created successfully Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fb0fca-6c7b-4978-a7fb-47e14a0f9045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:12 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Flow 'volume_create_manager' (9c3d9985-273a-4be5-a64e-e1de6953caae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:51:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0a244e87-e6fc-4ce4-8f7e-c40cb7235c73 tempest-VolumeImageDependencyTests-608820723 None] Created volume successfully. Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Acquiring lock "cinder-c1e8bc6e-b79a-422a-871b-3a1e127ec319-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "cinder-c1e8bc6e-b79a-422a-871b-3a1e127ec319-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Acquiring lock "cinder-quobyte-c1e8bc6e-b79a-422a-871b-3a1e127ec319" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "cinder-quobyte-c1e8bc6e-b79a-422a-871b-3a1e127ec319" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e875501-d95f-4219-ba8c-6d0b974fa718]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:13 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 Aug 20 06:51:13 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:14 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319" returned: 0 in 0.449s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:14 devstack sudo[112007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319 Aug 20 06:51:14 devstack sudo[112007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:14 devstack sudo[112007]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c1e8bc6e-b79a-422a-871b-3a1e127ec319" returned: 0 in 0.285s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "cinder-quobyte-c1e8bc6e-b79a-422a-871b-3a1e127ec319" released by "delete_volume" :: held 0.782s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Created reservations ['d64ebff5-10f8-4fe3-a7fe-90baa2174165', '3a0f27d8-96c8-4657-9340-6265ac5af584', '6e60c4bf-9048-402e-8352-2f6fac58ae38', '9b601dd2-b6dc-43e7-97dd-adb0fdc3bf7c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:14 devstack sudo[112010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:51:14 devstack sudo[112010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:15 devstack sudo[112010]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:15 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:51:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Deleted volume successfully. Aug 20 06:51:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-49d4a034-8a74-4235-917f-7ebdd25b32a7 tempest-VolumeImageDependencyTests-608820723 None] Lock "cinder-c1e8bc6e-b79a-422a-871b-3a1e127ec319-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:24 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=104,cinder:INSERT=33,cinder:UPDATE=161,cinder:DELETE=16 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:51:25 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:INSERT=50,cinder:UPDATE=149,cinder:SELECT=112,cinder:DELETE=9 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:34 devstack sudo[112118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:51:34 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:34 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:51:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Flow 'volume_create_manager' (5c70ab8b-4a0d-408e-beaf-65e79df2f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b60986e-272b-4ed7-98dc-dbcfd8012f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b60986e-272b-4ed7-98dc-dbcfd8012f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-96937233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ef9a81-3baf-4e0f-9096-0dedd9640395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc8461a10684bf98af7a35a994f51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:51:46Z,use_quota=True,user_id='ca856537e3294654a36273d9f3d1861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9530ee-1652-4a1f-8a74-81905e31f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9530ee-1652-4a1f-8a74-81905e31f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332ec04f-01ca-4064-9e17-2ae66ee7a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332ec04f-01ca-4064-9e17-2ae66ee7a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ef9a81-3baf-4e0f-9096-0dedd9640395', 'volume_name': 'volume-94ef9a81-3baf-4e0f-9096-0dedd9640395', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e693b722-bba4-4bb7-9bf1-ea9827b0ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e693b722-bba4-4bb7-9bf1-ea9827b0ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7fd0fd-01c1-49f8-8b95-34616beb2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Volume 94ef9a81-3baf-4e0f-9096-0dedd9640395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ef9a81-3baf-4e0f-9096-0dedd9640395', 'volume_size': 1} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-96937233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ef9a81-3baf-4e0f-9096-0dedd9640395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc8461a10684bf98af7a35a994f51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:51:46Z,use_quota=True,user_id='ca856537e3294654a36273d9f3d1861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Creating volume 94ef9a81-3baf-4e0f-9096-0dedd9640395 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:51:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:51:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:46 devstack sudo[112147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 1073741824 Aug 20 06:51:46 devstack sudo[112147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:46 devstack sudo[112147]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 1073741824" returned: 0 in 0.418s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:46 devstack sudo[112152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 Aug 20 06:51:46 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:46 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395" returned: 0 in 0.237s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7fd0fd-01c1-49f8-8b95-34616beb2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ef9a81-3baf-4e0f-9096-0dedd9640395', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e588290-d0e9-49c5-9bc2-8dd4d3e0d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:51:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Volume volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 (94ef9a81-3baf-4e0f-9096-0dedd9640395): created successfully Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e588290-d0e9-49c5-9bc2-8dd4d3e0d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:51:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Flow 'volume_create_manager' (5c70ab8b-4a0d-408e-beaf-65e79df2f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:51:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8040449e-d9a1-4c19-903b-9df5462f6a3a tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Created volume successfully. Aug 20 06:51:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-561121ec-de3e-4e8c-b0a4-bcc12f92d956 req-f6b071f4-c2bc-4664-bf27-95b5a5845f58 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-561121ec-de3e-4e8c-b0a4-bcc12f92d956 req-f6b071f4-c2bc-4664-bf27-95b5a5845f58 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [req-561121ec-de3e-4e8c-b0a4-bcc12f92d956 req-f6b071f4-c2bc-4664-bf27-95b5a5845f58 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-561121ec-de3e-4e8c-b0a4-bcc12f92d956 req-f6b071f4-c2bc-4664-bf27-95b5a5845f58 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2', 'name': 'volume-94ef9a81-3baf-4e0f-9096-0dedd9640395', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25b5c7f8-ad69-4875-ac86-a6f64858a97f', 'enforce_multipath': True} {{(pid=94234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 20 06:51:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-561121ec-de3e-4e8c-b0a4-bcc12f92d956 req-f6b071f4-c2bc-4664-bf27-95b5a5845f58 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] attachment_update completed successfully. Aug 20 06:51:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [req-4cd81c0d-2b5d-4c64-9bd7-55cd972d52d4 req-b93fd499-745a-4dcb-b00b-47baca55ca32 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Terminate volume connection completed successfully. Aug 20 06:51:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [req-4cd81c0d-2b5d-4c64-9bd7-55cd972d52d4 req-b93fd499-745a-4dcb-b00b-47baca55ca32 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Deleting attachment 25b5c7f8-ad69-4875-ac86-a6f64858a97f. {{(pid=94234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "cinder-94ef9a81-3baf-4e0f-9096-0dedd9640395-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "cinder-94ef9a81-3baf-4e0f-9096-0dedd9640395-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "cinder-quobyte-94ef9a81-3baf-4e0f-9096-0dedd9640395" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "cinder-quobyte-94ef9a81-3baf-4e0f-9096-0dedd9640395" acquired by "delete_volume" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[472816f8-5402-4251-aa2f-bd0175ae942a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:51:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:51 devstack sudo[112582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 Aug 20 06:51:51 devstack sudo[112582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:52 devstack sudo[112582]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:52 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395 Aug 20 06:51:52 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:52 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-94ef9a81-3baf-4e0f-9096-0dedd9640395" returned: 0 in 0.255s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "cinder-quobyte-94ef9a81-3baf-4e0f-9096-0dedd9640395" released by "delete_volume" :: held 0.654s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Created reservations ['1d502dac-e804-4673-a7ea-fee8835dcbe6', 'fbd07d42-f6d6-4d19-8a36-060458e1fbee', '87668626-7dcc-47a0-9306-4cab1ee504df', '53100092-1238-45aa-b9cc-200c2f1da982'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:51:52 devstack sudo[112590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:51:52 devstack sudo[112590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:51:52 devstack sudo[112590]: pam_unix(sudo:session): session closed for user root Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.249s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:51:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Deleted volume successfully. Aug 20 06:51:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a9f71eb6-98f4-4a6b-b284-bc8a31b09f78 tempest-TestServerVolumeAttachScenarioOldVersion-62874760 None] Lock "cinder-94ef9a81-3baf-4e0f-9096-0dedd9640395-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:02 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:52:02 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Flow 'volume_create_manager' (bacb3829-5567-48fb-a3b0-c47b11799d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57b77e5-d660-40eb-8b69-018565f7062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57b77e5-d660-40eb-8b69-018565f7062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8ed25b-c695-4f40-91fb-8841f92c3aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d85b7718ff4cdcbe4654a59ffc0abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:52:10Z,use_quota=True,user_id='4116278c10ba40e491ea2fa5f00733d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87c8b86-f672-4744-9cb1-39d347a3a84a),volume_type_id=c87c8b86-f672-4744-9cb1-39d347a3a84a)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858f958d-aacb-4e99-a128-ce35f2d31ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858f958d-aacb-4e99-a128-ce35f2d31ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48aaddb-7f64-4f49-83b4-5a809ae2f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48aaddb-7f64-4f49-83b4-5a809ae2f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f8ed25b-c695-4f40-91fb-8841f92c3aed', 'volume_name': 'volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed', 'volume_size': 1, 'image_id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b853b9832f3d12998280288e0644bbc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d85b7718ff4cdcbe4654a59ffc0abc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c6c6e8d9c9818bf08adcf99a0f9a3c2cec574d0bab20e67334f8ad9f9ba24e5a99a0587950658fca8b48e5c1af29d4d30e365151fa801acbf04c03160a569e6', 'id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'created_at': datetime.datetime(2026, 8, 20, 4, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b358e5e3-429b-4464-abd9-9bfad89c2e82/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e928265f-5329-4f6e-980d-25840ca13f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e928265f-5329-4f6e-980d-25840ca13f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeeffe85-4e2b-446a-bc46-26acc48c722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed', 'volume_size': 1, 'image_id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b853b9832f3d12998280288e0644bbc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d85b7718ff4cdcbe4654a59ffc0abc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c6c6e8d9c9818bf08adcf99a0f9a3c2cec574d0bab20e67334f8ad9f9ba24e5a99a0587950658fca8b48e5c1af29d4d30e365151fa801acbf04c03160a569e6', 'id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'created_at': datetime.datetime(2026, 8, 20, 4, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b358e5e3-429b-4464-abd9-9bfad89c2e82/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Trying to clone 6f8ed25b-c695-4f40-91fb-8841f92c3aed from image b358e5e3-429b-4464-abd9-9bfad89c2e82 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:52:10 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Image download 0.00 MB at 0.00 MB/s Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be58cce-604f-4f1a-88bb-f4c47f8b59ce]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:10 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:10 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:10 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:10 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:10 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:11 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 1 in 0.310s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Temporary image b358e5e3-429b-4464-abd9-9bfad89c2e82 is fetched for user 4116278c10ba40e491ea2fa5f00733d6. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[16361d96-cd86-45ef-982f-a559e1b99f2e]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:11 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:11 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:11 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 0 in 0.302s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:11 devstack sudo[112684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:11 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:11 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8ed25b-c695-4f40-91fb-8841f92c3aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d85b7718ff4cdcbe4654a59ffc0abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:52:10Z,use_quota=True,user_id='4116278c10ba40e491ea2fa5f00733d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87c8b86-f672-4744-9cb1-39d347a3a84a),volume_type_id=c87c8b86-f672-4744-9cb1-39d347a3a84a)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Creating volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:52:11 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:52:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:11 devstack sudo[112689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1073741824 Aug 20 06:52:11 devstack sudo[112689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:12 devstack sudo[112689]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1073741824" returned: 0 in 0.393s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:12 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed Aug 20 06:52:12 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:12 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed" returned: 0 in 0.237s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Attempting download of b358e5e3-429b-4464-abd9-9bfad89c2e82 ((None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}])) to volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[714baebc-91ff-4a29-b9a3-3b79f03a30e3]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:12 devstack sudo[112698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j Aug 20 06:52:12 devstack sudo[112698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:12 devstack sudo[112698]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j" returned: 0 in 0.314s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:13 devstack sudo[112702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j Aug 20 06:52:13 devstack sudo[112702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:13 devstack sudo[112702]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j" returned: 1 in 0.326s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b358e5e3-429b-4464-abd9-9bfad89c2e82_inps420j' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb51f3d-8c7d-4ee5-8866-ca7a00a99ddc]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:13 devstack sudo[112706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:13 devstack sudo[112706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:13 devstack sudo[112706]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:13 devstack sudo[112710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD Aug 20 06:52:13 devstack sudo[112710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:13 devstack sudo[112710]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] b358e5e3-429b-4464-abd9-9bfad89c2e82 was raw, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:52:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:13 devstack sudo[112715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed Aug 20 06:52:13 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:14 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b358e5e3-429b-4464-abd9-9bfad89c2e82_8u39ud3rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:52:14 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Converted 0.00 MB image at 0.00 MB/s Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:14 devstack sudo[112720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1G Aug 20 06:52:14 devstack sudo[112720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:14 devstack sudo[112720]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed 1G" returned: 0 in 0.300s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Downloaded image b358e5e3-429b-4464-abd9-9bfad89c2e82 ((None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}])) to volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Temporary image b358e5e3-429b-4464-abd9-9bfad89c2e82 for user 4116278c10ba40e491ea2fa5f00733d6 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Marking volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Copying metadata from image b358e5e3-429b-4464-abd9-9bfad89c2e82 to 6f8ed25b-c695-4f40-91fb-8841f92c3aed. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Creating volume glance metadata for volume 6f8ed25b-c695-4f40-91fb-8841f92c3aed backed by image b358e5e3-429b-4464-abd9-9bfad89c2e82 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b853b9832f3d12998280288e0644bbc5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeeffe85-4e2b-446a-bc46-26acc48c722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed', 'volume_size': 1, 'image_id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b358e5e3-429b-4464-abd9-9bfad89c2e82', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b853b9832f3d12998280288e0644bbc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d85b7718ff4cdcbe4654a59ffc0abc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c6c6e8d9c9818bf08adcf99a0f9a3c2cec574d0bab20e67334f8ad9f9ba24e5a99a0587950658fca8b48e5c1af29d4d30e365151fa801acbf04c03160a569e6', 'id': 'b358e5e3-429b-4464-abd9-9bfad89c2e82', 'created_at': datetime.datetime(2026, 8, 20, 4, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b358e5e3-429b-4464-abd9-9bfad89c2e82/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c751a8-6e8d-4a94-9000-715cacd1bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Volume volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed (6f8ed25b-c695-4f40-91fb-8841f92c3aed): created successfully Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c751a8-6e8d-4a94-9000-715cacd1bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Flow 'volume_create_manager' (bacb3829-5567-48fb-a3b0-c47b11799d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ebcff80c-a8b7-4d53-9c2f-3bedee5346f3 tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Created volume successfully. Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Acquiring lock "cinder-6f8ed25b-c695-4f40-91fb-8841f92c3aed-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "cinder-6f8ed25b-c695-4f40-91fb-8841f92c3aed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Acquiring lock "cinder-quobyte-6f8ed25b-c695-4f40-91fb-8841f92c3aed" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "cinder-quobyte-6f8ed25b-c695-4f40-91fb-8841f92c3aed" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c1a348-28f4-4aa9-993b-13ea7d3e301a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:15 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed Aug 20 06:52:15 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:15 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:15 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed Aug 20 06:52:15 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:16 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6f8ed25b-c695-4f40-91fb-8841f92c3aed" returned: 0 in 0.250s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "cinder-quobyte-6f8ed25b-c695-4f40-91fb-8841f92c3aed" released by "delete_volume" :: held 0.633s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:16 devstack cinder-volume[94234]: WARNING cinder.quota [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:52:16 devstack cinder-volume[94234]: WARNING cinder.quota [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Created reservations ['7cea51e9-fac1-4f6d-8b32-ab7bc06773ae', '63a57aea-0677-4b0b-9d32-846b5d62751c', '4f6a88e0-4386-4bf6-919c-7a055d4b7e25', '8f809f39-f815-4745-9c51-ee1831ae391a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:16 devstack sudo[112733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:52:16 devstack sudo[112733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:16 devstack sudo[112733]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.246s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:52:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Deleted volume successfully. Aug 20 06:52:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e4f3eb9c-b741-4dec-a205-dba0210e73ef tempest-VolumeAndVolumeTypeFromImageTest-700409539 None] Lock "cinder-6f8ed25b-c695-4f40-91fb-8841f92c3aed-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:26 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=13,cinder:INSERT=10,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:52:26 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=13,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:34 devstack sudo[112739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:52:34 devstack sudo[112739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:34 devstack sudo[112739]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:52:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Flow 'volume_create_manager' (899f0f0e-6da4-40d1-b742-2d7ac3fcc085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd6c9db-b974-475f-98da-f88bf39819bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd6c9db-b974-475f-98da-f88bf39819bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1677979366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064585ae-1fbe-4374-882b-088f646cf08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d9d448daf74e289347d95510e49170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:52:43Z,use_quota=True,user_id='4e8057da74c44124ae7b08de65650dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e2eea-0b84-4bba-a899-bb201fd1d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e2eea-0b84-4bba-a899-bb201fd1d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b965e5b-32af-4fb2-a5a2-06ffb6a4b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b965e5b-32af-4fb2-a5a2-06ffb6a4b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064585ae-1fbe-4374-882b-088f646cf08d', 'volume_name': 'volume-064585ae-1fbe-4374-882b-088f646cf08d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad439a00-014f-4b7b-9a1c-540a0e7b0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad439a00-014f-4b7b-9a1c-540a0e7b0e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4792abe7-7b8a-447d-a48f-e238bb2de3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Volume 064585ae-1fbe-4374-882b-088f646cf08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064585ae-1fbe-4374-882b-088f646cf08d', 'volume_size': 1} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1677979366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064585ae-1fbe-4374-882b-088f646cf08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d9d448daf74e289347d95510e49170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:52:43Z,use_quota=True,user_id='4e8057da74c44124ae7b08de65650dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Creating volume 064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:52:42 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:52:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:42 devstack sudo[112746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d 1073741824 Aug 20 06:52:42 devstack sudo[112746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:43 devstack sudo[112746]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d 1073741824" returned: 0 in 0.419s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:43 devstack sudo[112752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:43 devstack sudo[112752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:43 devstack sudo[112752]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4792abe7-7b8a-447d-a48f-e238bb2de3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064585ae-1fbe-4374-882b-088f646cf08d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08922351-5024-4d31-a9f0-baefcb3c9a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Volume volume-064585ae-1fbe-4374-882b-088f646cf08d (064585ae-1fbe-4374-882b-088f646cf08d): created successfully Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08922351-5024-4d31-a9f0-baefcb3c9a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Flow 'volume_create_manager' (899f0f0e-6da4-40d1-b742-2d7ac3fcc085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e26c00d4-4255-4df6-a88a-d27751015de8 tempest-SnapshotDependencyTests-851678324 None] Created volume successfully. Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Creating offline snapshot c25bf962-eefa-4265-82f9-91e7ef960e71 of volume 064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2fd209-42dc-4554-ba5d-62666a99f439]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:44 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:44 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:44 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.354s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:44 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 1G Aug 20 06:52:44 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:44 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 1G" returned: 0 in 0.378s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064585ae-1fbe-4374-882b-088f646cf08d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:44 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064585ae-1fbe-4374-882b-088f646cf08d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:44 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:45 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064585ae-1fbe-4374-882b-088f646cf08d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:45 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 is being set with open permissions: ugo+rw Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:45 devstack sudo[112770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:45 devstack sudo[112770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:45 devstack sudo[112770]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:45 devstack sudo[112773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info Aug 20 06:52:45 devstack sudo[112773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:45 devstack sudo[112773]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info" returned: 0 in 0.240s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:45 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info is being set with open permissions: ugo+rw Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:45 devstack sudo[112778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info Aug 20 06:52:45 devstack sudo[112778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:45 devstack sudo[112778]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.info" returned: 0 in 0.261s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ce72d0e6-69f9-4f95-97a8-9af8b4f65028 tempest-SnapshotDependencyTests-851678324 None] Create snapshot completed successfully Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Flow 'volume_create_manager' (568e653d-a7ae-4d5a-9493-e24043e3b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a912a24a-f1b8-4486-b5d2-3005e3af572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a912a24a-f1b8-4486-b5d2-3005e3af572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a500ee-ec7a-4d80-8982-355fa323794c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d9d448daf74e289347d95510e49170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c25bf962-eefa-4265-82f9-91e7ef960e71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:52:47Z,use_quota=True,user_id='4e8057da74c44124ae7b08de65650dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4bab7a-f00f-4ae1-bd70-ed800a6be9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4bab7a-f00f-4ae1-bd70-ed800a6be9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7d60b4-d01e-4a0d-9f1e-22b29b128a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7d60b4-d01e-4a0d-9f1e-22b29b128a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62a500ee-ec7a-4d80-8982-355fa323794c', 'volume_name': 'volume-62a500ee-ec7a-4d80-8982-355fa323794c', 'volume_size': 1, 'snapshot_id': 'c25bf962-eefa-4265-82f9-91e7ef960e71'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75cf7e-3f0b-45fd-8438-25ebf29f4cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75cf7e-3f0b-45fd-8438-25ebf29f4cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e668270-a097-42c0-991a-23abfa77524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Volume 62a500ee-ec7a-4d80-8982-355fa323794c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62a500ee-ec7a-4d80-8982-355fa323794c', 'volume_size': 1, 'snapshot_id': 'c25bf962-eefa-4265-82f9-91e7ef960e71'} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71-62a500ee-ec7a-4d80-8982-355fa323794c" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71-62a500ee-ec7a-4d80-8982-355fa323794c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Creating volume 62a500ee-ec7a-4d80-8982-355fa323794c from snapshot c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] snapshot: c25bf962-eefa-4265-82f9-91e7ef960e71, volume: 62a500ee-ec7a-4d80-8982-355fa323794c, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039ebb8-f0d6-4fc1-a2ec-f442cb523590]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:47 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:47 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:47 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.368s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-064585ae-1fbe-4374-882b-088f646cf08d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eb3d68-4a0d-47e1-a261-04c89477f2f3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:47 devstack sudo[112786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:47 devstack sudo[112786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:47 devstack sudo[112786]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:52:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:47 devstack sudo[112791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c Aug 20 06:52:47 devstack sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:51 devstack sudo[112791]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c" returned: 0 in 4.145s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:51 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:52:51 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Converted 1024.00 MB image at 246.98 MB/s Aug 20 06:52:51 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c is being set with open permissions: ugo+rw Aug 20 06:52:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:51 devstack sudo[112805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c Aug 20 06:52:51 devstack sudo[112805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:52 devstack sudo[112805]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" released by "_copy_volume_from_snapshot" :: held 5.194s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71-62a500ee-ec7a-4d80-8982-355fa323794c" released by "_create_volume_from_snapshot" :: held 5.306s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.320s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e668270-a097-42c0-991a-23abfa77524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a500ee-ec7a-4d80-8982-355fa323794c', 'volume_size': 1, 'snapshot_id': 'c25bf962-eefa-4265-82f9-91e7ef960e71'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1648e366-9fdb-439f-8c70-cb83770d28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:52:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Volume volume-62a500ee-ec7a-4d80-8982-355fa323794c (62a500ee-ec7a-4d80-8982-355fa323794c): created successfully Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1648e366-9fdb-439f-8c70-cb83770d28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:52:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Flow 'volume_create_manager' (568e653d-a7ae-4d5a-9493-e24043e3b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:52:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a280a777-92fb-42d3-9fe9-5c16265a68ae tempest-SnapshotDependencyTests-851678324 None] Created volume successfully. Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-c25bf962-eefa-4265-82f9-91e7ef960e71-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-c25bf962-eefa-4265-82f9-91e7ef960e71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Deleting offline snapshot c25bf962-eefa-4265-82f9-91e7ef960e71 of volume 064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] snapshot_file for this snap is: volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2c60b-0fef-4d66-bc6b-c8d2e8781ac6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:53 devstack sudo[112808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:53 devstack sudo[112808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:53 devstack sudo[112808]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.355s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-064585ae-1fbe-4374-882b-088f646cf08d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab1a86d-99bb-4012-b501-d808995dd5b4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:53 devstack sudo[112813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:53 devstack sudo[112813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:54 devstack sudo[112813]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.551s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:54 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:54 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:54 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.335s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:54 devstack sudo[112823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71 Aug 20 06:52:54 devstack sudo[112823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:54 devstack sudo[112823]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d.c25bf962-eefa-4265-82f9-91e7ef960e71" returned: 0 in 0.238s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-c25bf962-eefa-4265-82f9-91e7ef960e71" released by "_delete_snapshot" :: held 1.575s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" released by "delete_snapshot" :: held 1.597s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Created reservations ['1850e4b3-fdbb-4475-932d-40a5b189c9c1', '4b837cef-3c4f-436f-b8c9-d72da34fcf7a', '85474d97-85dd-42cf-a185-11a22a3d10b0', 'c65246bc-2504-479d-99fd-551058b3f404'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:52:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Delete snapshot completed successfully. Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-37aaeddf-cac4-4129-af74-703eb4ef629e tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-c25bf962-eefa-4265-82f9-91e7ef960e71-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-064585ae-1fbe-4374-882b-088f646cf08d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-064585ae-1fbe-4374-882b-088f646cf08d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac096b7d-cf3e-4c77-8259-791d777f304b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:55 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:55 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:55 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.369s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:55 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d Aug 20 06:52:55 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:56 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-064585ae-1fbe-4374-882b-088f646cf08d" returned: 0 in 0.255s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-064585ae-1fbe-4374-882b-088f646cf08d" released by "delete_volume" :: held 0.709s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Created reservations ['7fe6b096-bae7-4e04-9d6e-b29a6fdc9b04', 'f7b3c814-8f17-429a-b3df-18f8b39a3aa3', '8af9d39c-8438-4e3f-bc41-c75896d9bc74', 'f9518376-6e95-438b-b50e-fa24024bd265'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:56 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:52:56 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:56 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.257s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:52:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Deleted volume successfully. Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-62a500ee-ec7a-4d80-8982-355fa323794c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-47525a52-79b1-45c4-9409-09929ed4fe7f tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-064585ae-1fbe-4374-882b-088f646cf08d-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-62a500ee-ec7a-4d80-8982-355fa323794c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[48809efe-575d-4179-bd45-895d64068ffd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:52:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:56 devstack sudo[112873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c Aug 20 06:52:56 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:57 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:57 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c Aug 20 06:52:57 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:57 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-62a500ee-ec7a-4d80-8982-355fa323794c" returned: 0 in 0.260s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-quobyte-62a500ee-ec7a-4d80-8982-355fa323794c" released by "delete_volume" :: held 0.659s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Created reservations ['aefa8ab9-45d9-4733-94e6-20426af3c550', '951a33df-7e30-4099-99e5-f3b1f2597b63', '42b9eb89-9eae-41cf-a4d7-103a2ef2e483', '34f5582a-89dd-4a31-bdce-033e682a65ff'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:52:57 devstack sudo[112882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:52:57 devstack sudo[112882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:52:57 devstack sudo[112882]: pam_unix(sudo:session): session closed for user root Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:52:57 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Deleted volume successfully. Aug 20 06:52:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d31a722b-20ef-4a52-8565-ac4d700cabb1 tempest-SnapshotDependencyTests-851678324 None] Lock "cinder-62a500ee-ec7a-4d80-8982-355fa323794c-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:07 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=21,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=1 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:53:07 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=22,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=4 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Flow 'volume_create_manager' (5b27daf7-919d-4e5d-a191-f3f29fe9fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c91f1f6-a41c-42e1-b210-4b2b4b46b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c91f1f6-a41c-42e1-b210-4b2b4b46b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1048989807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3260fa8d8094ba3a8d50f02770186a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:18Z,use_quota=True,user_id='1851c1b75dac400c9af23b547e215b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4403643-0ced-4565-ad51-2e8a8ad25e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4403643-0ced-4565-ad51-2e8a8ad25e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0f494b-6849-4a46-9264-9be58f4e5462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0f494b-6849-4a46-9264-9be58f4e5462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a', 'volume_name': 'volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dc0723-2487-4b36-8fe6-b0de93b62435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dc0723-2487-4b36-8fe6-b0de93b62435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5bd5384-edce-4964-ac92-9185470b7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Volume c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a', 'volume_size': 1} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1048989807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3260fa8d8094ba3a8d50f02770186a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:18Z,use_quota=True,user_id='1851c1b75dac400c9af23b547e215b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Creating volume c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:18 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:18 devstack sudo[112936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a 1073741824 Aug 20 06:53:18 devstack sudo[112936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (8c31baeb-f641-4641-972a-304e47293e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b538c-ae94-4958-99e0-6a3311b145a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b538c-ae94-4958-99e0-6a3311b145a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203529396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f00c56-55ec-489a-ae68-722441b62da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:19Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afd49c4-c9b4-4573-87b0-12e4ed109fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afd49c4-c9b4-4573-87b0-12e4ed109fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a8beb-29db-4d23-9cde-ce89cbc24d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a8beb-29db-4d23-9cde-ce89cbc24d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f00c56-55ec-489a-ae68-722441b62da3', 'volume_name': 'volume-00f00c56-55ec-489a-ae68-722441b62da3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0722a9d-f8d5-41ea-90f6-8b50f9f5dc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0722a9d-f8d5-41ea-90f6-8b50f9f5dc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dda52d1-6b65-40f9-bc06-91e8b5a3ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:18 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Volume 00f00c56-55ec-489a-ae68-722441b62da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f00c56-55ec-489a-ae68-722441b62da3', 'volume_size': 1} Aug 20 06:53:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (e03be7c0-2741-4ac6-a86c-df52d7c4fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b34c77-dd04-4cbc-a1ef-e5e6fa52b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack sudo[112936]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b34c77-dd04-4cbc-a1ef-e5e6fa52b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220130011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525beab1-d5df-45f0-8f88-b24eb8fc1434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:19Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe95a3c-624f-401b-af48-46a7adb302f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe95a3c-624f-401b-af48-46a7adb302f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52680684-28df-42e3-80a6-178461bf1d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52680684-28df-42e3-80a6-178461bf1d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525beab1-d5df-45f0-8f88-b24eb8fc1434', 'volume_name': 'volume-525beab1-d5df-45f0-8f88-b24eb8fc1434', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6896454c-a00d-4ec4-b436-568e17d508c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6896454c-a00d-4ec4-b436-568e17d508c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51903939-719e-43f3-8ad3-28e51d4b428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Volume 525beab1-d5df-45f0-8f88-b24eb8fc1434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525beab1-d5df-45f0-8f88-b24eb8fc1434', 'volume_size': 1} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a 1073741824" returned: 0 in 0.647s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:19 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:19 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (9566a511-486a-4e64-be3a-8158da3084bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53818937-7643-4c97-85b3-ceb8ede1e11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53818937-7643-4c97-85b3-ceb8ede1e11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569809486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06c86c8-cd3d-458e-9115-a648ad6ecec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2b769-382a-461b-ac01-11f829189e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2b769-382a-461b-ac01-11f829189e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65e82f4-da35-4e31-815c-3ed88f7c14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65e82f4-da35-4e31-815c-3ed88f7c14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06c86c8-cd3d-458e-9115-a648ad6ecec0', 'volume_name': 'volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795b01e0-a392-4665-9dc2-05317fb7fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795b01e0-a392-4665-9dc2-05317fb7fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a888ffa-afaf-419d-a2b0-a4082f51afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume c06c86c8-cd3d-458e-9115-a648ad6ecec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0', 'volume_size': 1} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:19 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.440s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203529396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f00c56-55ec-489a-ae68-722441b62da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:19Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Creating volume 00f00c56-55ec-489a-ae68-722441b62da3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:19 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:19 devstack sudo[112945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 1073741824 Aug 20 06:53:19 devstack sudo[112945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (63ef9af8-035a-42d2-b221-8b828d234975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd2105e-831c-463a-8427-514ad1c2b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5bd5384-edce-4964-ac92-9185470b7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd29dd95-7329-4bd2-aa72-1b20f72f4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Volume volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a (c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a): created successfully Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd29dd95-7329-4bd2-aa72-1b20f72f4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Flow 'volume_create_manager' (5b27daf7-919d-4e5d-a191-f3f29fe9fe30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd2105e-831c-463a-8427-514ad1c2b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396388954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1976e8a9-8101-4fb0-b0fd-879b25e910f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bc9b0-5add-442a-8f81-8fce642fd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bc9b0-5add-442a-8f81-8fce642fd863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc97c89b-5b54-4b64-b25b-46dafc37c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc97c89b-5b54-4b64-b25b-46dafc37c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1976e8a9-8101-4fb0-b0fd-879b25e910f8', 'volume_name': 'volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40925a2-f89c-4865-97e3-052046831a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40925a2-f89c-4865-97e3-052046831a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37d0d8c-250f-4252-9ddc-7af2e47fa2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:19 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Volume 1976e8a9-8101-4fb0-b0fd-879b25e910f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8', 'volume_size': 1} Aug 20 06:53:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-faf34ddf-bada-420b-9a97-dd3b082296cc tempest-VolumeDependencyTests-1809726505 None] Created volume successfully. Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (b7b9f18e-4f12-43f9-9c56-8195672be023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ee5456-e644-4af1-8530-1e688f2c9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ee5456-e644-4af1-8530-1e688f2c9edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831788921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f07ddde-c4c5-40d3-91ef-89897c7fb599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f40dc6-3d3f-454a-89c4-0bace330fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f40dc6-3d3f-454a-89c4-0bace330fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514c6943-0c91-46c9-892a-4f02afad3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514c6943-0c91-46c9-892a-4f02afad3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f07ddde-c4c5-40d3-91ef-89897c7fb599', 'volume_name': 'volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e16cdb4-75e5-4736-9919-8e4a86de1f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e16cdb4-75e5-4736-9919-8e4a86de1f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb451729-5f81-434b-b394-a4288d454825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Volume 3f07ddde-c4c5-40d3-91ef-89897c7fb599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599', 'volume_size': 1} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:20 devstack sudo[112945]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 1073741824" returned: 0 in 0.703s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:20 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 Aug 20 06:53:20 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (e55396ab-8840-4d63-8ce8-5ffa44c3011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742c65e8-cd7f-4a27-8668-e9907e947b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742c65e8-cd7f-4a27-8668-e9907e947b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296377757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc798d8d-6781-4f3b-a6be-739e560dd980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:21Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe469b36-e97f-40d8-a911-adc8dcb48b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe469b36-e97f-40d8-a911-adc8dcb48b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8a0ebe-3f51-4dd2-acb3-f71f80596961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8a0ebe-3f51-4dd2-acb3-f71f80596961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc798d8d-6781-4f3b-a6be-739e560dd980', 'volume_name': 'volume-bc798d8d-6781-4f3b-a6be-739e560dd980', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809e9c6d-072f-4080-8245-5c4e7fc8a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809e9c6d-072f-4080-8245-5c4e7fc8a48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30732dcd-7de7-4f6a-806b-35575b36a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Volume bc798d8d-6781-4f3b-a6be-739e560dd980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc798d8d-6781-4f3b-a6be-739e560dd980', 'volume_size': 1} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:20 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3" returned: 0 in 0.304s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220130011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525beab1-d5df-45f0-8f88-b24eb8fc1434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:19Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Creating volume 525beab1-d5df-45f0-8f88-b24eb8fc1434 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dda52d1-6b65-40f9-bc06-91e8b5a3ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f00c56-55ec-489a-ae68-722441b62da3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7c7714-9ae3-4c3a-bb32-c778ddf5b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Volume volume-00f00c56-55ec-489a-ae68-722441b62da3 (00f00c56-55ec-489a-ae68-722441b62da3): created successfully Aug 20 06:53:20 devstack sudo[112954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 1073741824 Aug 20 06:53:20 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7c7714-9ae3-4c3a-bb32-c778ddf5b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (8c31baeb-f641-4641-972a-304e47293e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:20 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-28a19e97-321b-4dea-b84f-dcbb33ad8c76 tempest-CreateVolumesFromImageTest-2134377529 None] Created volume successfully. Aug 20 06:53:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:21 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 1073741824" returned: 0 in 0.541s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:21 devstack sudo[112960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 Aug 20 06:53:21 devstack sudo[112960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:21 devstack sudo[112960]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434" returned: 0 in 0.291s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569809486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06c86c8-cd3d-458e-9115-a648ad6ecec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume c06c86c8-cd3d-458e-9115-a648ad6ecec0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:21 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:21 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 1073741824 Aug 20 06:53:21 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51903939-719e-43f3-8ad3-28e51d4b428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525beab1-d5df-45f0-8f88-b24eb8fc1434', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00680712-c24d-4cf9-9594-dbc8155c02bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:21 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Volume volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 (525beab1-d5df-45f0-8f88-b24eb8fc1434): created successfully Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00680712-c24d-4cf9-9594-dbc8155c02bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:21 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (e03be7c0-2741-4ac6-a86c-df52d7c4fb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:21 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-4cbee849-faa7-45b8-989c-7faf74c4f6d2 tempest-CreateVolumesFromImageTest-2134377529 None] Created volume successfully. Aug 20 06:53:22 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 1073741824" returned: 0 in 0.482s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:22 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 Aug 20 06:53:22 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:22 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0" returned: 0 in 0.270s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.554s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396388954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1976e8a9-8101-4fb0-b0fd-879b25e910f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Creating volume 1976e8a9-8101-4fb0-b0fd-879b25e910f8 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:22 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a888ffa-afaf-419d-a2b0-a4082f51afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:22 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 1073741824 Aug 20 06:53:22 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f6f192-969c-4865-9e74-e7c65f0f4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:22 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 (c06c86c8-cd3d-458e-9115-a648ad6ecec0): created successfully Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f6f192-969c-4865-9e74-e7c65f0f4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (9566a511-486a-4e64-be3a-8158da3084bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5620cb9f-922a-4b87-9076-0fb4c3b7d10d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Flow 'volume_create_manager' (9480227e-b884-416b-a5e0-646b9ea2d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaca399-f0a4-4770-b486-0a9ebcc7f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaca399-f0a4-4770-b486-0a9ebcc7f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cf0598-3cff-46a6-bed9-9d1960525153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc6591963244cf7ae189b6d4d3887d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:23Z,use_quota=True,user_id='61749d96337c4deba2690c41a6aba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a63a581d-1039-441d-bf34-9c18071f7aab),volume_type_id=a63a581d-1039-441d-bf34-9c18071f7aab)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259fd7f9-f8ec-422c-b1d7-1217b45c0282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259fd7f9-f8ec-422c-b1d7-1217b45c0282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dfeb39-109b-4cb5-8b25-45360caa0b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:22 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dfeb39-109b-4cb5-8b25-45360caa0b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34cf0598-3cff-46a6-bed9-9d1960525153', 'volume_name': 'volume-34cf0598-3cff-46a6-bed9-9d1960525153', 'volume_size': 1, 'image_id': '0664f17d-e473-4625-abab-4294b661e614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c56edbdff58cd3d8917994a06a84308', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bc6591963244cf7ae189b6d4d3887d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9793db216874f0607d5a50c4a24e186ce4e55db08796f2565bbb72581d2b66659b373d87d14b9a683bb86cd2b4a99e70d3abcb43780745d34a906dc4d472327', 'id': '0664f17d-e473-4625-abab-4294b661e614', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0664f17d-e473-4625-abab-4294b661e614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:23 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ecc9d5-596b-4e64-9182-892c3882249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ecc9d5-596b-4e64-9182-892c3882249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b98313-f381-441a-94e4-86b9e12b0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Volume 34cf0598-3cff-46a6-bed9-9d1960525153: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34cf0598-3cff-46a6-bed9-9d1960525153', 'volume_size': 1, 'image_id': '0664f17d-e473-4625-abab-4294b661e614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c56edbdff58cd3d8917994a06a84308', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bc6591963244cf7ae189b6d4d3887d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9793db216874f0607d5a50c4a24e186ce4e55db08796f2565bbb72581d2b66659b373d87d14b9a683bb86cd2b4a99e70d3abcb43780745d34a906dc4d472327', 'id': '0664f17d-e473-4625-abab-4294b661e614', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0664f17d-e473-4625-abab-4294b661e614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Trying to clone 34cf0598-3cff-46a6-bed9-9d1960525153 from image 0664f17d-e473-4625-abab-4294b661e614 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 1073741824" returned: 0 in 0.480s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:23 devstack sudo[112977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 Aug 20 06:53:23 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:53:23 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Image download 0.00 MB at 0.00 MB/s Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc155668-9cfa-4dc2-bff2-2ac228ed7194]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:23 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:23 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:23 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8" returned: 0 in 0.255s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831788921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f07ddde-c4c5-40d3-91ef-89897c7fb599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:20Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Creating volume 3f07ddde-c4c5-40d3-91ef-89897c7fb599 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:23 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37d0d8c-250f-4252-9ddc-7af2e47fa2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7dfb4-fb61-4ec9-9400-9f1879e4360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:23 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 1073741824 Aug 20 06:53:23 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Volume volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 (1976e8a9-8101-4fb0-b0fd-879b25e910f8): created successfully Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7dfb4-fb61-4ec9-9400-9f1879e4360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (63ef9af8-035a-42d2-b221-8b828d234975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fc98f6de-cc07-4545-a9b9-aa65760140f8 tempest-CreateVolumesFromImageTest-2134377529 None] Created volume successfully. Aug 20 06:53:23 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:23 devstack sudo[112986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:23 devstack sudo[112986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:23 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 1073741824" returned: 0 in 0.528s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:23 devstack sudo[112986]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:23 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Temporary image 0664f17d-e473-4625-abab-4294b661e614 is fetched for user 61749d96337c4deba2690c41a6aba885. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:53:23 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 Aug 20 06:53:23 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4d27e-28bf-4f6f-b802-9d9254a7375d]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:24 devstack sudo[112997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:24 devstack sudo[112997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:24 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.426s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296377757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc798d8d-6781-4f3b-a6be-739e560dd980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83c98a4bab948a9825a16e9ba83b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:21Z,use_quota=True,user_id='2dd38be3a3f14c629894e465f2615284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Creating volume bc798d8d-6781-4f3b-a6be-739e560dd980 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:24 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb451729-5f81-434b-b394-a4288d454825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb5f96-d26d-4cb8-92b9-8b65a3a8b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack sudo[113000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 1073741824 Aug 20 06:53:24 devstack sudo[113000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Volume volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 (3f07ddde-c4c5-40d3-91ef-89897c7fb599): created successfully Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb5f96-d26d-4cb8-92b9-8b65a3a8b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (b7b9f18e-4f12-43f9-9c56-8195672be023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (29ed0aad-24cf-4982-804b-f63ae03912ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6fd998-f504-4df7-aaed-56db5b4c735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7b97bf9f-3fbf-47bc-a7df-0991342c769e tempest-CreateVolumesFromImageTest-2134377529 None] Created volume successfully. Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6fd998-f504-4df7-aaed-56db5b4c735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62181585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051cec00-414b-4084-86d4-f9cf3bfbafc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:24Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80457cf-2385-470e-a829-23052d4ddf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80457cf-2385-470e-a829-23052d4ddf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1e38e8-50d8-4a04-9476-bf00895190f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1e38e8-50d8-4a04-9476-bf00895190f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051cec00-414b-4084-86d4-f9cf3bfbafc9', 'volume_name': 'volume-051cec00-414b-4084-86d4-f9cf3bfbafc9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e731b4-75af-407b-93fe-b3da68dad8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e731b4-75af-407b-93fe-b3da68dad8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08097197-561f-415a-8e29-b95649f92fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume 051cec00-414b-4084-86d4-f9cf3bfbafc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051cec00-414b-4084-86d4-f9cf3bfbafc9', 'volume_size': 1} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:24 devstack sudo[112997]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:24 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:24 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:24 devstack sudo[113000]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (1dcefdde-a930-4bde-a812-a6e34030c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d584dd-958f-4d4f-88c0-7ad01679f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 1073741824" returned: 0 in 0.567s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d584dd-958f-4d4f-88c0-7ad01679f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397698733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3755c623-73ff-48ef-ba51-bbc6bbe9c43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e05e5-4d48-4689-9a1b-869beb44f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e05e5-4d48-4689-9a1b-869beb44f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761dfb5a-6ce2-4981-a52e-d68d045e71b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761dfb5a-6ce2-4981-a52e-d68d045e71b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3755c623-73ff-48ef-ba51-bbc6bbe9c43c', 'volume_name': 'volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc64ca7-d60e-4892-82f1-8cdc85137517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc64ca7-d60e-4892-82f1-8cdc85137517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cdad23-7ea5-411c-8d96-d439fc283a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume 3755c623-73ff-48ef-ba51-bbc6bbe9c43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c', 'volume_size': 1} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:24 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:24 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 Aug 20 06:53:24 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (309a199f-11bc-4270-87c2-7483da964c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91cffc-2614-4d3b-98ea-2897972dbdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91cffc-2614-4d3b-98ea-2897972dbdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254513113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca62403-45f3-4914-a9a5-55932849db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb795b4-151c-4216-99e3-2ab66a69b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb795b4-151c-4216-99e3-2ab66a69b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ee4da-36ff-416b-b48a-092cb7d39ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ee4da-36ff-416b-b48a-092cb7d39ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca62403-45f3-4914-a9a5-55932849db88', 'volume_name': 'volume-cca62403-45f3-4914-a9a5-55932849db88', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebedd38-3673-45ea-81b3-0c5534330655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebedd38-3673-45ea-81b3-0c5534330655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae8b038-b1e7-41ca-a592-21632b5ad188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume cca62403-45f3-4914-a9a5-55932849db88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca62403-45f3-4914-a9a5-55932849db88', 'volume_size': 1} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980" returned: 0 in 0.379s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.283s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30732dcd-7de7-4f6a-806b-35575b36a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc798d8d-6781-4f3b-a6be-739e560dd980', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96691f5-0097-4e43-bd07-df1311744226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Creating offline snapshot cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 of volume c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:53:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Volume volume-bc798d8d-6781-4f3b-a6be-739e560dd980 (bc798d8d-6781-4f3b-a6be-739e560dd980): created successfully Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96691f5-0097-4e43-bd07-df1311744226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Flow 'volume_create_manager' (e55396ab-8840-4d63-8ce8-5ffa44c3011f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad362d0-8a32-45e4-b685-e86c7aa84709]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:25 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-42c24de0-d0b1-48b0-b959-a7c389edf44c tempest-CreateVolumesFromImageTest-2134377529 None] Created volume successfully. Aug 20 06:53:25 devstack sudo[113016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:25 devstack sudo[113016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (37f5aacc-bb47-4486-8603-a14ede67cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe7fcf-5e5f-438a-a06a-c4565e8a868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe7fcf-5e5f-438a-a06a-c4565e8a868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289013367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c651996e-33c7-40c8-b032-b8e1ef91c3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece4181e-68f1-46bd-9c6d-a5e547a2cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece4181e-68f1-46bd-9c6d-a5e547a2cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aae5393-8a4c-4cf3-9cf9-cf9b42d39d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aae5393-8a4c-4cf3-9cf9-cf9b42d39d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c651996e-33c7-40c8-b032-b8e1ef91c3ec', 'volume_name': 'volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f991bb7b-6281-4220-a89d-671d77af78df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f991bb7b-6281-4220-a89d-671d77af78df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65038b4-e396-4751-a06b-83af08e1e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume c651996e-33c7-40c8-b032-b8e1ef91c3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec', 'volume_size': 1} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:25 devstack sudo[113016]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.415s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:25 devstack sudo[113021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 1G Aug 20 06:53:25 devstack sudo[113021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (9d62a1b1-d5cd-45a7-8d6b-729e21dd08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed14862-2909-414e-a42b-10f949617fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed14862-2909-414e-a42b-10f949617fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448881755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6dc418-cf99-4143-948e-55771c55af4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:26Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4492a42-6958-465c-9d7b-b106cb232b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4492a42-6958-465c-9d7b-b106cb232b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303311c4-4186-46c2-a931-fe0f4df846fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303311c4-4186-46c2-a931-fe0f4df846fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6dc418-cf99-4143-948e-55771c55af4c', 'volume_name': 'volume-0d6dc418-cf99-4143-948e-55771c55af4c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c59cef8-6b02-4d8d-aacd-7afe365faa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c59cef8-6b02-4d8d-aacd-7afe365faa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9e7a2-812d-467f-8c9a-d87ad2cac0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume 0d6dc418-cf99-4143-948e-55771c55af4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6dc418-cf99-4143-948e-55771c55af4c', 'volume_size': 1} Aug 20 06:53:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:26 devstack sudo[113021]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 1G" returned: 0 in 0.424s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:26 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:26 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-bc798d8d-6781-4f3b-a6be-739e560dd980-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-bc798d8d-6781-4f3b-a6be-739e560dd980-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-quobyte-bc798d8d-6781-4f3b-a6be-739e560dd980" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:26 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-bc798d8d-6781-4f3b-a6be-739e560dd980" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.368s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:26 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 is being set with open permissions: ugo+rw Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df1091-4f6d-4851-838a-c1f5382c4882]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:26 devstack sudo[113032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:26 devstack sudo[113032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:26 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 Aug 20 06:53:26 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:26 devstack sudo[113032]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.270s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:26 devstack sudo[113038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info Aug 20 06:53:26 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:26 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:26 devstack sudo[113042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980 Aug 20 06:53:26 devstack sudo[113042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:27 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info" returned: 0 in 0.276s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:27 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info is being set with open permissions: ugo+rw Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:27 devstack sudo[113045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info Aug 20 06:53:27 devstack sudo[113045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:27 devstack sudo[113042]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bc798d8d-6781-4f3b-a6be-739e560dd980" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-bc798d8d-6781-4f3b-a6be-739e560dd980" released by "delete_volume" :: held 0.708s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Created reservations ['f9c66e51-380d-4190-bfff-cfca706eac63', 'd4080e98-4e16-46b8-beea-b479cb5bfc6d', 'a908bdf5-fb72-475e-9ae5-d200414b3085', '13e5f64b-558f-4bf5-8324-dc392fd5b399'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:27 devstack sudo[113048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:27 devstack sudo[113048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:27 devstack sudo[113045]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.info" returned: 0 in 0.284s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62181585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051cec00-414b-4084-86d4-f9cf3bfbafc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:24Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume 051cec00-414b-4084-86d4-f9cf3bfbafc9 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:27 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:27 devstack sudo[113051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 1073741824 Aug 20 06:53:27 devstack sudo[113051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:27 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-811773f5-1d09-4f63-bc77-dd0baa9ebd3b tempest-VolumeDependencyTests-1809726505 None] Create snapshot completed successfully Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-3f07ddde-c4c5-40d3-91ef-89897c7fb599-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:27 devstack sudo[113048]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:27 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Deleted volume successfully. Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-3f07ddde-c4c5-40d3-91ef-89897c7fb599-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7098128e-0a4d-44c2-906d-ed20c5fb4e50 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-bc798d8d-6781-4f3b-a6be-739e560dd980-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-quobyte-3f07ddde-c4c5-40d3-91ef-89897c7fb599" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-3f07ddde-c4c5-40d3-91ef-89897c7fb599" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215e422-7cd1-4174-936b-e0a637d10958]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:27 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 Aug 20 06:53:27 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:27 devstack sudo[113051]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 1073741824" returned: 0 in 0.487s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:27 devstack sudo[113061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 Aug 20 06:53:27 devstack sudo[113061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:28 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599" returned: 0 in 0.382s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:28 devstack sudo[113066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599 Aug 20 06:53:28 devstack sudo[113066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:28 devstack sudo[113061]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9" returned: 0 in 0.268s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.372s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397698733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3755c623-73ff-48ef-ba51-bbc6bbe9c43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume 3755c623-73ff-48ef-ba51-bbc6bbe9c43c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:28 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08097197-561f-415a-8e29-b95649f92fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051cec00-414b-4084-86d4-f9cf3bfbafc9', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e973354a-e02b-4b2a-963e-168ff66b7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:28 devstack sudo[113069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c 1073741824 Aug 20 06:53:28 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 (051cec00-414b-4084-86d4-f9cf3bfbafc9): created successfully Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e973354a-e02b-4b2a-963e-168ff66b7392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (29ed0aad-24cf-4982-804b-f63ae03912ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8c1ba86a-d666-4f7c-92ac-7d5b723db63d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:28 devstack sudo[113066]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3f07ddde-c4c5-40d3-91ef-89897c7fb599" returned: 0 in 0.290s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-3f07ddde-c4c5-40d3-91ef-89897c7fb599" released by "delete_volume" :: held 0.715s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Created reservations ['9866fc06-317a-42c2-a8dc-342af2ffb9d8', 'e8e90453-3961-4a03-a2d3-69d893c9f75f', '21f9390a-3420-41ee-9a83-6c663645f951', '8c04522d-45ff-4047-8414-79f456ee6084'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:28 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:28 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-1976e8a9-8101-4fb0-b0fd-879b25e910f8-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:28 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c 1073741824" returned: 0 in 0.637s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-1976e8a9-8101-4fb0-b0fd-879b25e910f8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:28 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.365s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Deleted volume successfully. Aug 20 06:53:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:29 devstack sudo[113079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-quobyte-1976e8a9-8101-4fb0-b0fd-879b25e910f8" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:29 devstack sudo[113079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-dec9328d-ab35-4a4e-871e-850e7bb84fac tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-3f07ddde-c4c5-40d3-91ef-89897c7fb599-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-1976e8a9-8101-4fb0-b0fd-879b25e910f8" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Flow 'volume_create_manager' (45447d33-359e-4ce5-b675-efff086bd05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005e4bfd-7ade-4f49-b49d-479f33a91199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb44f4-989c-4098-99fb-85b089028667]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005e4bfd-7ade-4f49-b49d-479f33a91199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1575461134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf16fd49-a3ad-48a4-94b1-c65279efe5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3260fa8d8094ba3a8d50f02770186a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc7bf7aa-b910-41a7-8dd0-ec5187a7c390,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:29Z,use_quota=True,user_id='1851c1b75dac400c9af23b547e215b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b367a828-cd2d-45ac-9d3a-d45d689d47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b367a828-cd2d-45ac-9d3a-d45d689d47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a898a571-aabb-4a56-abed-2b4dc1b8dbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a898a571-aabb-4a56-abed-2b4dc1b8dbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf16fd49-a3ad-48a4-94b1-c65279efe5c2', 'volume_name': 'volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2', 'volume_size': 1, 'snapshot_id': 'cc7bf7aa-b910-41a7-8dd0-ec5187a7c390'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d885d26f-3e4a-48c6-8abe-e933cc909dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d885d26f-3e4a-48c6-8abe-e933cc909dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8156a5c1-e9b5-42b2-a7aa-1dca4c0cb85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Volume bf16fd49-a3ad-48a4-94b1-c65279efe5c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2', 'volume_size': 1, 'snapshot_id': 'cc7bf7aa-b910-41a7-8dd0-ec5187a7c390'} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:29 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 Aug 20 06:53:29 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:29 devstack sudo[113079]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.353s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cf0598-3cff-46a6-bed9-9d1960525153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc6591963244cf7ae189b6d4d3887d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:23Z,use_quota=True,user_id='61749d96337c4deba2690c41a6aba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a63a581d-1039-441d-bf34-9c18071f7aab),volume_type_id=a63a581d-1039-441d-bf34-9c18071f7aab)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Creating volume 34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:29 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cdad23-7ea5-411c-8d96-d439fc283a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1073741824 Aug 20 06:53:29 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e58499-4163-47db-b6ad-c53eb900c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:29 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c (3755c623-73ff-48ef-ba51-bbc6bbe9c43c): created successfully Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e58499-4163-47db-b6ad-c53eb900c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (1dcefdde-a930-4bde-a812-a6e34030c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:29 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-611d5260-68ad-4880-8209-e22f8dd534fc tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:29 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8" returned: 0 in 0.414s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:29 devstack sudo[113092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8 Aug 20 06:53:29 devstack sudo[113092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:29 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1073741824" returned: 0 in 0.447s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:29 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 Aug 20 06:53:29 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:29 devstack sudo[113092]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1976e8a9-8101-4fb0-b0fd-879b25e910f8" returned: 0 in 0.295s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-1976e8a9-8101-4fb0-b0fd-879b25e910f8" released by "delete_volume" :: held 0.779s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Created reservations ['72907249-414b-437e-8c43-e58a4495e24a', 'a8797e43-db93-4681-b05d-de07bd47515d', 'ecc65629-9c91-4005-a937-1a895e343805', '4e22f4a8-8ed3-4e0c-af54-3d0e6b4c26e6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack sudo[113099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:30 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153" returned: 0 in 0.293s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.801s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254513113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca62403-45f3-4914-a9a5-55932849db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume cca62403-45f3-4914-a9a5-55932849db88 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-525beab1-d5df-45f0-8f88-b24eb8fc1434-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:30 devstack sudo[113102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 1073741824 Aug 20 06:53:30 devstack sudo[113102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-525beab1-d5df-45f0-8f88-b24eb8fc1434-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Attempting download of 0664f17d-e473-4625-abab-4294b661e614 ((None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}])) to volume 34cf0598-3cff-46a6-bed9-9d1960525153. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-quobyte-525beab1-d5df-45f0-8f88-b24eb8fc1434" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-525beab1-d5df-45f0-8f88-b24eb8fc1434" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15a51b-017e-436f-a724-2fb6e5248535]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7d97f5-52aa-4b09-b93e-a70be10499c7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Deleted volume successfully. Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d99f0c4a-6fc0-47f8-93fd-21d0d1674473 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-1976e8a9-8101-4fb0-b0fd-879b25e910f8-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:30 devstack sudo[113104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33 Aug 20 06:53:30 devstack sudo[113104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 Aug 20 06:53:30 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113102]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 1073741824" returned: 0 in 0.518s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack sudo[113104]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33" returned: 0 in 0.408s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack sudo[113118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 Aug 20 06:53:30 devstack sudo[113118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434" returned: 0 in 0.426s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack sudo[113121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434 Aug 20 06:53:30 devstack sudo[113121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33 Aug 20 06:53:30 devstack sudo[113119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack sudo[113118]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.320s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289013367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c651996e-33c7-40c8-b032-b8e1ef91c3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:25Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume c651996e-33c7-40c8-b032-b8e1ef91c3ec {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae8b038-b1e7-41ca-a592-21632b5ad188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca62403-45f3-4914-a9a5-55932849db88', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:30 devstack sudo[113121]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afee7c0-fc7c-4ab3-9732-e8f83456c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:30 devstack sudo[113126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec 1073741824 Aug 20 06:53:30 devstack sudo[113126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-525beab1-d5df-45f0-8f88-b24eb8fc1434" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-525beab1-d5df-45f0-8f88-b24eb8fc1434" released by "delete_volume" :: held 0.786s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:31 devstack sudo[113119]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-cca62403-45f3-4914-a9a5-55932849db88 (cca62403-45f3-4914-a9a5-55932849db88): created successfully Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afee7c0-fc7c-4ab3-9732-e8f83456c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (309a199f-11bc-4270-87c2-7483da964c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33" returned: 1 in 0.373s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0664f17d-e473-4625-abab-4294b661e614_aqcdkz33' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cee391f-91de-453e-b17b-d915d743a5dd]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7a4c5121-7338-4b3a-8a1c-c746c8884a5d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Created reservations ['15b5fc4d-b8d7-4866-a9b2-7827486bd3e4', 'dcf66a5d-4cd0-4977-9075-21d6d9f4f3c2', '87fc0242-8184-40cd-9120-b3eb04375eee', 'd0a202e9-4a34-4dbc-aa26-604889e34911'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:31 devstack sudo[113130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:31 devstack sudo[113130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:31 devstack sudo[113134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-00f00c56-55ec-489a-ae68-722441b62da3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-00f00c56-55ec-489a-ae68-722441b62da3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:31 devstack sudo[113130]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "cinder-quobyte-00f00c56-55ec-489a-ae68-722441b62da3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-00f00c56-55ec-489a-ae68-722441b62da3" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec37c4ee-844b-4713-970f-7a66dc3fdace]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113126]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec 1073741824" returned: 0 in 0.620s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack sudo[113134]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.375s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Deleted volume successfully. Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7f1a5c6a-db6d-418c-97a3-5dcbc3c88c38 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-525beab1-d5df-45f0-8f88-b24eb8fc1434-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD Aug 20 06:53:31 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack sudo[113144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec Aug 20 06:53:31 devstack sudo[113144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack sudo[113142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 Aug 20 06:53:31 devstack sudo[113142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] 0664f17d-e473-4625-abab-4294b661e614 was raw, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113144]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack sudo[113153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 Aug 20 06:53:31 devstack sudo[113153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.966s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448881755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6dc418-cf99-4143-948e-55771c55af4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9cd8409cc148e69402a52f5ec95d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:26Z,use_quota=True,user_id='95fde6e86ebc47ffa7db6b3ce187c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Creating volume 0d6dc418-cf99-4143-948e-55771c55af4c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:31 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113142]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3" returned: 0 in 0.401s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:31 devstack sudo[113156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c 1073741824 Aug 20 06:53:31 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65038b4-e396-4751-a06b-83af08e1e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8c014d-99ee-49f8-b310-b422c9c9db88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:31 devstack sudo[113157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3 Aug 20 06:53:31 devstack sudo[113157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec (c651996e-33c7-40c8-b032-b8e1ef91c3ec): created successfully Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8c014d-99ee-49f8-b310-b422c9c9db88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (37f5aacc-bb47-4486-8603-a14ede67cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0c60d370-18cb-409a-8b9d-6d2610b6d171 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:32 devstack sudo[113157]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-00f00c56-55ec-489a-ae68-722441b62da3" returned: 0 in 0.292s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-quobyte-00f00c56-55ec-489a-ae68-722441b62da3" released by "delete_volume" :: held 0.739s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Created reservations ['0184efe0-f4f3-4e98-82e3-9b2385555cbf', '497351c2-24f5-44ee-8f35-dfd7f44ca4a7', '5422078a-1c28-435c-9222-1fe003d71725', 'a917bca4-40b1-4929-bc50-28a12e7902ca'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:32 devstack sudo[113153]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153" returned: 0 in 0.579s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0664f17d-e473-4625-abab-4294b661e614_39bk_jwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:53:32 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Converted 0.00 MB image at 0.00 MB/s Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:32 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:32 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:32 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1G Aug 20 06:53:32 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:32 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c 1073741824" returned: 0 in 0.576s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:32 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c Aug 20 06:53:32 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:32 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:32 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Deleted volume successfully. Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e26352b6-3d18-443d-b3ee-8ef6b86ad277 tempest-CreateVolumesFromImageTest-2134377529 None] Lock "cinder-00f00c56-55ec-489a-ae68-722441b62da3-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:32 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 1G" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Downloaded image 0664f17d-e473-4625-abab-4294b661e614 ((None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}])) to volume 34cf0598-3cff-46a6-bed9-9d1960525153 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Temporary image 0664f17d-e473-4625-abab-4294b661e614 for user 61749d96337c4deba2690c41a6aba885 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Marking volume 34cf0598-3cff-46a6-bed9-9d1960525153 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Copying metadata from image 0664f17d-e473-4625-abab-4294b661e614 to 34cf0598-3cff-46a6-bed9-9d1960525153. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Creating volume glance metadata for volume 34cf0598-3cff-46a6-bed9-9d1960525153 backed by image 0664f17d-e473-4625-abab-4294b661e614 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0664f17d-e473-4625-abab-4294b661e614', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8c56edbdff58cd3d8917994a06a84308', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b98313-f381-441a-94e4-86b9e12b0266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cf0598-3cff-46a6-bed9-9d1960525153', 'volume_size': 1, 'image_id': '0664f17d-e473-4625-abab-4294b661e614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0664f17d-e473-4625-abab-4294b661e614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c56edbdff58cd3d8917994a06a84308', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bc6591963244cf7ae189b6d4d3887d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9793db216874f0607d5a50c4a24e186ce4e55db08796f2565bbb72581d2b66659b373d87d14b9a683bb86cd2b4a99e70d3abcb43780745d34a906dc4d472327', 'id': '0664f17d-e473-4625-abab-4294b661e614', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0664f17d-e473-4625-abab-4294b661e614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cde62d-4288-42fe-a492-ea75dc423cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:32 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c" returned: 0 in 0.387s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.735s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:32 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Volume volume-34cf0598-3cff-46a6-bed9-9d1960525153 (34cf0598-3cff-46a6-bed9-9d1960525153): created successfully Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cde62d-4288-42fe-a492-ea75dc423cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Flow 'volume_create_manager' (9480227e-b884-416b-a5e0-646b9ea2d934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9e7a2-812d-467f-8c9a-d87ad2cac0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6dc418-cf99-4143-948e-55771c55af4c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79bcab-5620-4e42-892e-9018b6c6944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Creating volume bf16fd49-a3ad-48a4-94b1-c65279efe5c2 from snapshot cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:32 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Volume volume-0d6dc418-cf99-4143-948e-55771c55af4c (0d6dc418-cf99-4143-948e-55771c55af4c): created successfully Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79bcab-5620-4e42-892e-9018b6c6944a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Flow 'volume_create_manager' (9d62a1b1-d5cd-45a7-8d6b-729e21dd08cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-85842ad4-384a-4ff1-86f7-c1d78e34aac1 tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Created volume successfully. Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] snapshot: cc7bf7aa-b910-41a7-8dd0-ec5187a7c390, volume: bf16fd49-a3ad-48a4-94b1-c65279efe5c2, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:53:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7b8f6849-2f79-4df0-acd7-d5d4a7ea1e92 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created volume successfully. Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a11fe-0bbe-466c-9605-e0cec0684c62]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:33 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:33 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:33 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbef32b-30b0-488b-92cc-b41cada0121e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:33 devstack sudo[113187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:33 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-0d6dc418-cf99-4143-948e-55771c55af4c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Acquiring lock "cinder-34cf0598-3cff-46a6-bed9-9d1960525153-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-0d6dc418-cf99-4143-948e-55771c55af4c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "cinder-34cf0598-3cff-46a6-bed9-9d1960525153-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:33 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.438s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:53:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:33 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 Aug 20 06:53:33 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-0d6dc418-cf99-4143-948e-55771c55af4c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Acquiring lock "cinder-quobyte-34cf0598-3cff-46a6-bed9-9d1960525153" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-0d6dc418-cf99-4143-948e-55771c55af4c" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "cinder-quobyte-34cf0598-3cff-46a6-bed9-9d1960525153" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd497d59-8dc2-4a64-bb13-46661fa398a4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd0c515-b582-42d1-9831-db54c72e3c51]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:34 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c Aug 20 06:53:34 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack sudo[113195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 Aug 20 06:53:34 devstack sudo[113195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:34 devstack sudo[113202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:34 devstack sudo[113202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c" returned: 0 in 0.472s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:34 devstack sudo[113212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c Aug 20 06:53:34 devstack sudo[113212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack sudo[113195]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153" returned: 0 in 0.647s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:34 devstack sudo[113218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153 Aug 20 06:53:34 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:34 devstack sudo[113202]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.550s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:53:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:53:35 devstack sudo[113212]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0d6dc418-cf99-4143-948e-55771c55af4c" returned: 0 in 0.901s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-0d6dc418-cf99-4143-948e-55771c55af4c" released by "delete_volume" :: held 1.447s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:35 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-34cf0598-3cff-46a6-bed9-9d1960525153" returned: 0 in 0.777s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "cinder-quobyte-34cf0598-3cff-46a6-bed9-9d1960525153" released by "delete_volume" :: held 1.524s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['f44b0688-9c40-4dc8-8889-b3ca9cace6d0', 'a754b5da-9eab-40c0-a1d0-2e7d10f33c48', '8ec408f5-3b30-4779-8d91-dcadf9213311', '9bb7da01-f340-4fef-a2a1-387b37ae5a11'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Created reservations ['843f4a0d-cd7c-4297-b771-e51c608010f7', '092e2f8e-d22c-4bb3-8407-595beff3c8a0', '7590885a-cbf5-41c0-9ab0-8f31470ee9b7', '783cc6f4-56eb-4e65-b6d6-ed0231048294'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:36 devstack sudo[113223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:36 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:36 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:36 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-c651996e-33c7-40c8-b032-b8e1ef91c3ec-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-c651996e-33c7-40c8-b032-b8e1ef91c3ec-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:36 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.660s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-c651996e-33c7-40c8-b032-b8e1ef91c3ec" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-c651996e-33c7-40c8-b032-b8e1ef91c3ec" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8cd8c8ff-60b6-4dfa-9720-c4f7db6ba170 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-0d6dc418-cf99-4143-948e-55771c55af4c-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf5f09-d532-42b2-b2e6-26292678038b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:37 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec Aug 20 06:53:37 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:37 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 1.169s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:37 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Deleted volume successfully. Aug 20 06:53:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-6ba288a0-1a31-48fe-94d6-3a478ae1fe2f tempest-VolumeAndVolumeTypeFromImageTest-1135669028 None] Lock "cinder-34cf0598-3cff-46a6-bed9-9d1960525153-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:38 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec" returned: 0 in 1.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:38 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec Aug 20 06:53:38 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:38 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c651996e-33c7-40c8-b032-b8e1ef91c3ec" returned: 0 in 0.635s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-c651996e-33c7-40c8-b032-b8e1ef91c3ec" released by "delete_volume" :: held 2.056s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['7648ac4c-e5e4-47e8-b499-15d288eb1788', '10b1b1a0-0fe1-4a69-9965-4adf7f074866', '719a9fff-b289-4868-88f5-0cf77d8b5d7c', '8fe0d26b-e7c3-4cbb-80e3-d1d3da2b6bb3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:39 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:39 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:39 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.487s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:39 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:39 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9f573824-393c-4955-962c-ed9b43866020 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-c651996e-33c7-40c8-b032-b8e1ef91c3ec-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:40 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" returned: 0 in 6.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:53:40 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Converted 1024.00 MB image at 162.55 MB/s Aug 20 06:53:40 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 is being set with open permissions: ugo+rw Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:40 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 Aug 20 06:53:40 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-cca62403-45f3-4914-a9a5-55932849db88-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-cca62403-45f3-4914-a9a5-55932849db88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-cca62403-45f3-4914-a9a5-55932849db88" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-cca62403-45f3-4914-a9a5-55932849db88" acquired by "delete_volume" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bdcdbe-481c-4ac9-b241-e8f31fbd0a5b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:40 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:40 devstack sudo[113243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" released by "_copy_volume_from_snapshot" :: held 7.622s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:40 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" released by "_create_volume_from_snapshot" :: held 7.735s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.782s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8156a5c1-e9b5-42b2-a7aa-1dca4c0cb85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2', 'volume_size': 1, 'snapshot_id': 'cc7bf7aa-b910-41a7-8dd0-ec5187a7c390'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba2fd7-4efc-4009-824b-5aac41abc236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Volume volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 (bf16fd49-a3ad-48a4-94b1-c65279efe5c2): created successfully Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba2fd7-4efc-4009-824b-5aac41abc236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Flow 'volume_create_manager' (45447d33-359e-4ce5-b675-efff086bd05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:40 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ebf4c65d-85c2-49d7-bca0-0f8678399061 tempest-VolumeDependencyTests-1809726505 None] Created volume successfully. Aug 20 06:53:40 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88" returned: 0 in 0.493s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:41 devstack sudo[113249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88 Aug 20 06:53:41 devstack sudo[113249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:41 devstack sudo[113249]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cca62403-45f3-4914-a9a5-55932849db88" returned: 0 in 0.323s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-cca62403-45f3-4914-a9a5-55932849db88" released by "delete_volume" :: held 0.888s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['1cff1ff6-12b5-43dc-8cd3-f34a28d9333d', '807b1889-89f1-45e8-a608-efb477824e0b', 'f99a1c8f-061a-4c16-b647-674d5bf6039f', '0dad32d8-0366-4a0d-a032-afc10c5bf3cb'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Deleting offline snapshot cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 of volume c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] snapshot_file for this snap is: volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[00abe7e4-ffc1-4c38-9c4e-705f228a200f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:41 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:41 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:41 devstack sudo[113252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:41 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:41 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.314s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:41 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f236c85f-b325-4259-ab54-eef257eed737 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-cca62403-45f3-4914-a9a5-55932849db88-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:42 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3681010-bce3-465a-a6f9-417dd0b9e937]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:42 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:42 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-3755c623-73ff-48ef-ba51-bbc6bbe9c43c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-3755c623-73ff-48ef-ba51-bbc6bbe9c43c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:42 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.673s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:42 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:42 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" acquired by "delete_volume" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Flow 'volume_create_manager' (31c1902f-a169-453e-890b-3a15540adb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e1ca2c-4a53-474d-afee-9e272bea6fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[024407aa-7833-4dfa-8fb0-13abd13e3250]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e1ca2c-4a53-474d-afee-9e272bea6fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b57701f-62f9-435d-af35-5df881a58494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88349037a4674ef7a018f4880dcd4945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:43Z,use_quota=True,user_id='77a6e64a999b4ce99a3141bd7272b251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f8eed6-00c3-4de8-92fe-98becd0ef329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f8eed6-00c3-4de8-92fe-98becd0ef329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb61e43-e856-475f-b750-cd9ad839681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:42 devstack cinder-volume[94234]: DEBUG cinder.image.glance [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Creating Keystone auth plugin from conf {{(pid=94234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 20 06:53:43 devstack sudo[113269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c Aug 20 06:53:43 devstack sudo[113269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:43 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.414s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:43 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390 Aug 20 06:53:43 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb61e43-e856-475f-b750-cd9ad839681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b57701f-62f9-435d-af35-5df881a58494', 'volume_name': 'volume-2b57701f-62f9-435d-af35-5df881a58494', 'volume_size': 1, 'image_id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150467b2a19bcce7ee5bd14937065a0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88349037a4674ef7a018f4880dcd4945', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c937afb961685098e62922a4cd24d99e85016516593d76d73ac94c0c2319f1208176b29de4fd6199e9ea98e0d567f1ed09de77c2d5ef4365f8aa40999212d50d', 'id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/492446e4-d9bf-4928-8e73-6e410e634ce3/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dd163b-47c0-4c4b-8c09-bb0bceb111f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dd163b-47c0-4c4b-8c09-bb0bceb111f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431273a1-c89b-4236-950d-bc96bc637956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:43 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Volume 2b57701f-62f9-435d-af35-5df881a58494: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b57701f-62f9-435d-af35-5df881a58494', 'volume_size': 1, 'image_id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150467b2a19bcce7ee5bd14937065a0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88349037a4674ef7a018f4880dcd4945', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c937afb961685098e62922a4cd24d99e85016516593d76d73ac94c0c2319f1208176b29de4fd6199e9ea98e0d567f1ed09de77c2d5ef4365f8aa40999212d50d', 'id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/492446e4-d9bf-4928-8e73-6e410e634ce3/file', 'properties': {}}, 'image_service': } Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Trying to clone 2b57701f-62f9-435d-af35-5df881a58494 from image 492446e4-d9bf-4928-8e73-6e410e634ce3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}]). {{(pid=94234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 20 06:53:43 devstack sudo[113269]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" returned: 0 in 0.476s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:43 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c Aug 20 06:53:43 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 20 06:53:43 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Image download 0.00 MB at 0.00 MB/s Aug 20 06:53:43 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a.cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a216f3-2e58-44b1-b027-c0aacc36ef01]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390" released by "_delete_snapshot" :: held 2.029s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" released by "delete_snapshot" :: held 2.068s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:43 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" returned: 0 in 0.329s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:43 devstack sudo[113283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:43 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Created reservations ['7ec64587-cf19-4808-b6d8-fc059e194896', '56c159c0-c32c-4930-8823-cfb272476c3a', 'c83a9073-3885-4007-a85d-ee2541691191', '9cc07622-ec84-49c7-8c0e-25766a2df090'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-3755c623-73ff-48ef-ba51-bbc6bbe9c43c" released by "delete_volume" :: held 0.896s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Delete snapshot completed successfully. Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-133d4d10-7191-4b85-bb68-a36df2a852ba tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-cc7bf7aa-b910-41a7-8dd0-ec5187a7c390-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['aca9e591-941e-4bd5-93df-cccd87ab30b0', '3d38d96a-3d79-4cb1-a0d4-3a5a9ba5a51a', '0afb0e0b-9332-4d80-92bb-98aa83a3bcbf', 'f0f0a42b-ee75-4204-bd77-9ff27ab77397'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:43 devstack sudo[113286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:43 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:44 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:44 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:44 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:44 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c7cc7841-2082-4ed9-85d7-2a617d26d62d tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-3755c623-73ff-48ef-ba51-bbc6bbe9c43c-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (9b61c90d-1cf0-434b-a401-5e7add99a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b54a72-8c27-43b8-9bab-3aa687c74149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:44 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b54a72-8c27-43b8-9bab-3aa687c74149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659780615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae49280-c49a-43bc-818b-78e5acd50d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:44Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f63e5a-863d-4cef-9697-28edf00e8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f63e5a-863d-4cef-9697-28edf00e8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92dd89-4c21-48b7-bd45-1811ebee9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92dd89-4c21-48b7-bd45-1811ebee9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae49280-c49a-43bc-818b-78e5acd50d53', 'volume_name': 'volume-fae49280-c49a-43bc-818b-78e5acd50d53', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f07a18-c20c-4757-a541-efc53d77f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f07a18-c20c-4757-a541-efc53d77f51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8c3a4a-aa06-4044-93c1-6f94873b5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:44 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume fae49280-c49a-43bc-818b-78e5acd50d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae49280-c49a-43bc-818b-78e5acd50d53', 'volume_size': 1} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659780615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae49280-c49a-43bc-818b-78e5acd50d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:44Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:44 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Temporary image 492446e4-d9bf-4928-8e73-6e410e634ce3 is fetched for user 77a6e64a999b4ce99a3141bd7272b251. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 20 06:53:44 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 1073741824 Aug 20 06:53:44 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e8b7f4-7ecf-4de8-9dd8-caab130c3981]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:44 devstack sudo[113298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:44 devstack sudo[113298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab2350-f894-4a6f-a752-12c4343b0025]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:44 devstack sudo[113298]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:44 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:44 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-051cec00-414b-4084-86d4-f9cf3bfbafc9-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-051cec00-414b-4084-86d4-f9cf3bfbafc9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:45 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 1073741824" returned: 0 in 0.573s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-051cec00-414b-4084-86d4-f9cf3bfbafc9" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:45 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:45 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-051cec00-414b-4084-86d4-f9cf3bfbafc9" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:45 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 Aug 20 06:53:45 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ad3d4-3950-4d0a-81ac-4ae56f60b4de]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack sudo[113312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 Aug 20 06:53:45 devstack sudo[113312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:45 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.510s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a Aug 20 06:53:45 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53" returned: 0 in 0.316s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b57701f-62f9-435d-af35-5df881a58494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88349037a4674ef7a018f4880dcd4945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:43Z,use_quota=True,user_id='77a6e64a999b4ce99a3141bd7272b251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Creating volume 2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8c3a4a-aa06-4044-93c1-6f94873b5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae49280-c49a-43bc-818b-78e5acd50d53', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:45 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1073741824 Aug 20 06:53:45 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fe80a0-90cd-45a9-aa13-e4ac4bf56d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-fae49280-c49a-43bc-818b-78e5acd50d53 (fae49280-c49a-43bc-818b-78e5acd50d53): created successfully Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fe80a0-90cd-45a9-aa13-e4ac4bf56d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (9b61c90d-1cf0-434b-a401-5e7add99a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-12da076e-42ae-43b1-93b0-1418f25ee266 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:45 devstack sudo[113312]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9" returned: 0 in 0.408s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9 Aug 20 06:53:45 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" returned: 0 in 0.271s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a" released by "delete_volume" :: held 0.849s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Created reservations ['ea0bf47c-9977-4d0a-ba74-3924aa7b189c', '09b6f46e-5eb3-4fc5-a44b-d5fc2ac81d2e', 'e79f0a4b-bd3a-4e36-986a-f5764cbc2cb9', 'ed0ad989-daf4-42a9-a55d-6ef4447a077f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:45 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:45 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:45 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-051cec00-414b-4084-86d4-f9cf3bfbafc9" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-051cec00-414b-4084-86d4-f9cf3bfbafc9" released by "delete_volume" :: held 0.756s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-bf16fd49-a3ad-48a4-94b1-c65279efe5c2-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-bf16fd49-a3ad-48a4-94b1-c65279efe5c2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['17523eda-3731-42ca-89b3-2869324de9da', '1a2336aa-9c9e-4c52-b280-c5c30dd9c53f', '44c630c3-e9f5-441a-8a27-80fef533dda3', 'ba324e0c-7ca3-4356-a66a-fabcd5841ad3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:45 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1073741824" returned: 0 in 0.592s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a5f669-72f0-4285-9e87-82da80277264]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 Aug 20 06:53:46 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.380s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Deleted volume successfully. Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-f8687585-49fd-450c-bc1c-c15ecd3d13f7 tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-c7ddb9e4-ec80-42d2-949c-3e6ab82cc97a-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:46 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:46 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-c06c86c8-cd3d-458e-9115-a648ad6ecec0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-c06c86c8-cd3d-458e-9115-a648ad6ecec0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "cinder-quobyte-c06c86c8-cd3d-458e-9115-a648ad6ecec0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-c06c86c8-cd3d-458e-9115-a648ad6ecec0" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:46 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 Aug 20 06:53:46 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18e202-6744-4705-b0c4-16af1910ba26]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494" returned: 0 in 0.340s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Attempting download of 492446e4-d9bf-4928-8e73-6e410e634ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}])) to volume 2b57701f-62f9-435d-af35-5df881a58494. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 20 06:53:46 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7100b4-e5ae-4778-abd0-20ec546049af]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:46 devstack sudo[113349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 Aug 20 06:53:46 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ae03c511-79dd-4a24-85e6-ee388c300e1a tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-051cec00-414b-4084-86d4-f9cf3bfbafc9-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:46 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" returned: 0 in 0.606s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3 Aug 20 06:53:46 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2 Aug 20 06:53:46 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating offline snapshot 7c547b9c-4111-471c-ae38-939fdd73966b of volume fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae35863-d9ba-4e0a-9096-c7dafaed07e7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0" returned: 0 in 0.587s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:46 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3" returned: 0 in 0.447s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0 Aug 20 06:53:47 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 Aug 20 06:53:47 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" returned: 0 in 0.393s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-quobyte-bf16fd49-a3ad-48a4-94b1-c65279efe5c2" released by "delete_volume" :: held 1.070s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:47 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3 Aug 20 06:53:47 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Created reservations ['214d4704-06b8-457e-be6d-81d4fc83eb70', 'ce230710-6339-4a87-a0ae-d3cf155104c4', '73ed90b5-733a-434f-89ac-9971f6602899', 'ae0583b5-403b-4e05-8eee-a064b3cf1294'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c06c86c8-cd3d-458e-9115-a648ad6ecec0" returned: 0 in 0.342s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-quobyte-c06c86c8-cd3d-458e-9115-a648ad6ecec0" released by "delete_volume" :: held 0.992s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:47 devstack sudo[113374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:47 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53" returned: 0 in 0.558s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3" returned: 1 in 0.422s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_492446e4-d9bf-4928-8e73-6e410e634ce3_b8d0ec_3' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c657f-9cb0-4252-82cd-c684c47d9e21]: (4, 'raw') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b 1G Aug 20 06:53:47 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Created reservations ['0153c790-48b3-485d-ac32-850670b26554', '38907564-54b8-4d10-9ea1-e0a7e52cc79a', '1ef94c45-9139-41d1-84a2-32a4e5171335', 'd3fa4530-8acb-4a69-b985-c1ec71156c2f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack sudo[113380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:47 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack sudo[113380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.298s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:47 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Deleted volume successfully. Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d2db074f-e795-4794-ab70-1e4765a2e94b tempest-VolumeDependencyTests-1809726505 None] Lock "cinder-bf16fd49-a3ad-48a4-94b1-c65279efe5c2-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:47 devstack sudo[113380]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.292s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Deleted volume successfully. Aug 20 06:53:47 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b 1G" returned: 0 in 0.459s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae49280-c49a-43bc-818b-78e5acd50d53 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-610e053b-175f-49f5-9189-6458d1f05be7 tempest-CreateVolumesFromSourceVolumeTest-1522565313 None] Lock "cinder-c06c86c8-cd3d-458e-9115-a648ad6ecec0-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:47 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae49280-c49a-43bc-818b-78e5acd50d53 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b Aug 20 06:53:47 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:47 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD Aug 20 06:53:47 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:48 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] 492446e4-d9bf-4928-8e73-6e410e634ce3 was raw, converting to qcow2 {{(pid=94234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:48 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae49280-c49a-43bc-818b-78e5acd50d53 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b is being set with open permissions: ugo+rw Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:48 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 Aug 20 06:53:48 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:48 devstack sudo[113406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b Aug 20 06:53:48 devstack sudo[113406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:48 devstack sudo[113406]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:48 devstack sudo[113413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info Aug 20 06:53:48 devstack sudo[113413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:48 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494" returned: 0 in 0.542s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_492446e4-d9bf-4928-8e73-6e410e634ce3_ttmtobshdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:53:48 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Converted 0.00 MB image at 0.00 MB/s Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:48 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1G Aug 20 06:53:48 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:48 devstack sudo[113413]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info is being set with open permissions: ugo+rw Aug 20 06:53:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:48 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info Aug 20 06:53:48 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:49 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 1G" returned: 0 in 0.387s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Downloaded image 492446e4-d9bf-4928-8e73-6e410e634ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}])) to volume 2b57701f-62f9-435d-af35-5df881a58494 successfully. {{(pid=94234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Temporary image 492446e4-d9bf-4928-8e73-6e410e634ce3 for user 77a6e64a999b4ce99a3141bd7272b251 is deleted. {{(pid=94234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.volume_utils [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Marking volume 2b57701f-62f9-435d-af35-5df881a58494 as bootable. {{(pid=94234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Copying metadata from image 492446e4-d9bf-4928-8e73-6e410e634ce3 to 2b57701f-62f9-435d-af35-5df881a58494. {{(pid=94234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Creating volume glance metadata for volume 2b57701f-62f9-435d-af35-5df881a58494 backed by image 492446e4-d9bf-4928-8e73-6e410e634ce3 with: {'image_id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '150467b2a19bcce7ee5bd14937065a0c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431273a1-c89b-4236-950d-bc96bc637956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b57701f-62f9-435d-af35-5df881a58494', 'volume_size': 1, 'image_id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/492446e4-d9bf-4928-8e73-6e410e634ce3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150467b2a19bcce7ee5bd14937065a0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88349037a4674ef7a018f4880dcd4945', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c937afb961685098e62922a4cd24d99e85016516593d76d73ac94c0c2319f1208176b29de4fd6199e9ea98e0d567f1ed09de77c2d5ef4365f8aa40999212d50d', 'id': '492446e4-d9bf-4928-8e73-6e410e634ce3', 'created_at': datetime.datetime(2026, 8, 20, 4, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 20, 4, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/492446e4-d9bf-4928-8e73-6e410e634ce3/file', 'properties': {}}, 'image_service': }' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db360b-09b5-433a-83b4-274382973b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:49 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Volume volume-2b57701f-62f9-435d-af35-5df881a58494 (2b57701f-62f9-435d-af35-5df881a58494): created successfully Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db360b-09b5-433a-83b4-274382973b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Flow 'volume_create_manager' (31c1902f-a169-453e-890b-3a15540adb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9ade6622-905b-40b5-952d-f4824e38b175 tempest-VolumeImageDependencyTests-1839604204 None] Created volume successfully. Aug 20 06:53:49 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.info" returned: 0 in 0.396s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-89bb7376-3015-4da9-9340-752a933125af tempest-CreateVolumesFromSnapshotTest-1309243408 None] Create snapshot completed successfully Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Acquiring lock "cinder-2b57701f-62f9-435d-af35-5df881a58494-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "cinder-2b57701f-62f9-435d-af35-5df881a58494-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Acquiring lock "cinder-quobyte-2b57701f-62f9-435d-af35-5df881a58494" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "cinder-quobyte-2b57701f-62f9-435d-af35-5df881a58494" acquired by "delete_volume" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f257a839-2411-4aec-98f3-ffa617847d42]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (3e6e895e-035a-4430-a7d4-09f0f314cc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2fb2c0-fe8d-4bd3-bde1-a4bb41fe26e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2fb2c0-fe8d-4bd3-bde1-a4bb41fe26e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224038288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977de959-e61f-45e1-bc12-2f023c4222f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:51Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:50 devstack sudo[113425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 Aug 20 06:53:50 devstack sudo[113425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a9036-6263-48c4-af3a-6bfbd90841ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a9036-6263-48c4-af3a-6bfbd90841ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3666b2f-567c-43fb-a67d-90355dd3d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3666b2f-567c-43fb-a67d-90355dd3d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977de959-e61f-45e1-bc12-2f023c4222f3', 'volume_name': 'volume-977de959-e61f-45e1-bc12-2f023c4222f3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad634f0-6a84-4ffe-a5b7-5da75730ceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad634f0-6a84-4ffe-a5b7-5da75730ceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3fb8ce-72e2-4f9b-a783-09c2ee3cabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:50 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume 977de959-e61f-45e1-bc12-2f023c4222f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977de959-e61f-45e1-bc12-2f023c4222f3', 'volume_size': 1} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224038288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977de959-e61f-45e1-bc12-2f023c4222f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:51Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume 977de959-e61f-45e1-bc12-2f023c4222f3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:50 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:50 devstack sudo[113427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 1073741824 Aug 20 06:53:50 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (56d2e8d5-7a76-4ae1-afbe-a1964ca083b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:51 devstack sudo[113425]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef9d8cf-30b0-4622-84fa-477aacb70bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494" returned: 0 in 0.643s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef9d8cf-30b0-4622-84fa-477aacb70bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589578782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7d287c-9af9-42bc-9b03-12a9c03d71c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:51Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack sudo[113435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494 Aug 20 06:53:51 devstack sudo[113435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757d50f6-ccd0-4863-80e9-fdbd3bb0ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757d50f6-ccd0-4863-80e9-fdbd3bb0ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75179d44-73aa-4c0b-8991-f38d6a601e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75179d44-73aa-4c0b-8991-f38d6a601e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7d287c-9af9-42bc-9b03-12a9c03d71c3', 'volume_name': 'volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30fa8a-2f5a-4c12-a271-d043fa8c8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30fa8a-2f5a-4c12-a271-d043fa8c8d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769de02-403c-4a26-9f56-a116413a0081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume 2c7d287c-9af9-42bc-9b03-12a9c03d71c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3', 'volume_size': 1} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:51 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 1073741824" returned: 0 in 0.780s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (272b8656-76fa-4cca-9b69-34a90dfccd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a0c199-a9fd-47bc-8648-5c8a9b426383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a0c199-a9fd-47bc-8648-5c8a9b426383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1429887574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0757ed1f-9795-4481-bd73-f8e27df8d63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:52Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36536b90-9caf-49be-b18e-91e8fcbcefc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36536b90-9caf-49be-b18e-91e8fcbcefc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc52f2-ba32-4921-bf5b-ffd8e0a1192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc52f2-ba32-4921-bf5b-ffd8e0a1192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0757ed1f-9795-4481-bd73-f8e27df8d63f', 'volume_name': 'volume-0757ed1f-9795-4481-bd73-f8e27df8d63f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d620a6aa-00a2-42c6-bee3-90232055ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d620a6aa-00a2-42c6-bee3-90232055ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e02d51-ed8f-4a59-bbc8-8eab8738f34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume 0757ed1f-9795-4481-bd73-f8e27df8d63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0757ed1f-9795-4481-bd73-f8e27df8d63f', 'volume_size': 1} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:51 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 Aug 20 06:53:51 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:51 devstack sudo[113435]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2b57701f-62f9-435d-af35-5df881a58494" returned: 0 in 0.642s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "cinder-quobyte-2b57701f-62f9-435d-af35-5df881a58494" released by "delete_volume" :: held 1.375s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Created reservations ['be1696db-ab1e-4b15-bafe-b6c69ee75ffa', 'b22778c4-4dfd-4d7f-8e06-224bda431d55', '11a846c8-20d4-4b6f-b93c-2f681a321774', '4f62903d-0b31-45c8-8a75-3d013ece7faf'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:52 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3" returned: 0 in 0.315s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589578782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7d287c-9af9-42bc-9b03-12a9c03d71c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:51Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume 2c7d287c-9af9-42bc-9b03-12a9c03d71c3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:52 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:52 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:52 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3fb8ce-72e2-4f9b-a783-09c2ee3cabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977de959-e61f-45e1-bc12-2f023c4222f3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ade9d-997b-40d1-8e00-0be89860e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack sudo[113444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 1073741824 Aug 20 06:53:52 devstack sudo[113444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-977de959-e61f-45e1-bc12-2f023c4222f3 (977de959-e61f-45e1-bc12-2f023c4222f3): created successfully Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ade9d-997b-40d1-8e00-0be89860e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (3e6e895e-035a-4430-a7d4-09f0f314cc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-850b7ea9-7827-461f-9a32-f60a39610379 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:52 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (cab64c86-c7fc-4b8a-b3af-17014adad67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a534a-f10c-499e-991e-35cea1dc9415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.583s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a534a-f10c-499e-991e-35cea1dc9415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-396500147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:53Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0512dd53-759b-4134-a9d8-644c42031993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0512dd53-759b-4134-a9d8-644c42031993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06a3bcb-251c-4637-9d88-5d8395f4e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06a3bcb-251c-4637-9d88-5d8395f4e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6', 'volume_name': 'volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb5e24f-ba12-4948-a4fb-6457d6af8422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb5e24f-ba12-4948-a4fb-6457d6af8422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca1a358-52e2-4f83-9e17-694f8c2bca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:52 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6', 'volume_size': 1} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Deleted volume successfully. Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-bf219b29-5d3c-46e1-a659-b0a2e0f702ee tempest-VolumeImageDependencyTests-1839604204 None] Lock "cinder-2b57701f-62f9-435d-af35-5df881a58494-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:52 devstack sudo[113444]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 1073741824" returned: 0 in 0.732s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:53 devstack sudo[113450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 Aug 20 06:53:53 devstack sudo[113450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (0bef61d2-56de-4a86-a2b6-f84960c67975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edee3e57-33a4-46b9-aa35-4193fb93b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edee3e57-33a4-46b9-aa35-4193fb93b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231129549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:53Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e05a8c-ff53-4782-a822-500b57f3795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e05a8c-ff53-4782-a822-500b57f3795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d246b041-8860-4739-a231-a78454d16e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d246b041-8860-4739-a231-a78454d16e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17', 'volume_name': 'volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e82872-dd0c-462c-b216-d73a963a4784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e82872-dd0c-462c-b216-d73a963a4784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0005122-b79d-4f7a-9418-0d4dfeb08b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17', 'volume_size': 1} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:53 devstack sudo[113450]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" returned: 0 in 0.546s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1429887574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0757ed1f-9795-4481-bd73-f8e27df8d63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:52Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume 0757ed1f-9795-4481-bd73-f8e27df8d63f {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:53 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769de02-403c-4a26-9f56-a116413a0081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6fb3e4-21e8-4bcc-a1e2-91fa65aeeab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f 1073741824 Aug 20 06:53:53 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 (2c7d287c-9af9-42bc-9b03-12a9c03d71c3): created successfully Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6fb3e4-21e8-4bcc-a1e2-91fa65aeeab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (56d2e8d5-7a76-4ae1-afbe-a1964ca083b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Flow 'volume_create_manager' (1f0c1712-0eb6-4286-9c12-d44086fe5b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af89aa5-c337-4f55-b21f-85b469574a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-068935aa-6596-4d5d-b280-97d5434dce73 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af89aa5-c337-4f55-b21f-85b469574a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fc1b8d-8844-4ef6-951d-f90c2983ac68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1946c2ae7a6943e5a9c6607c3270b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:54Z,use_quota=True,user_id='0fd912899fa54ee5b6fb232caff4f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cdeb2e-5525-4771-ab0e-422feea54c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cdeb2e-5525-4771-ab0e-422feea54c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dcd448-274f-447e-9410-fa08df1167af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dcd448-274f-447e-9410-fa08df1167af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fc1b8d-8844-4ef6-951d-f90c2983ac68', 'volume_name': 'volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bd22f7-1726-4c47-8501-8f7aea21b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bd22f7-1726-4c47-8501-8f7aea21b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c14a780-bf65-44ef-bd57-a106132f2307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:53 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Volume 63fc1b8d-8844-4ef6-951d-f90c2983ac68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68', 'volume_size': 1} Aug 20 06:53:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:54 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f 1073741824" returned: 0 in 0.572s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:54 devstack sudo[113459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f Aug 20 06:53:54 devstack sudo[113459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:54 devstack sudo[113459]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f" returned: 0 in 0.332s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-396500147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:53Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:54 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e02d51-ed8f-4a59-bbc8-8eab8738f34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0757ed1f-9795-4481-bd73-f8e27df8d63f', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a6f52-c22e-42c4-81da-f2746c849b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:54 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 1073741824 Aug 20 06:53:54 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:54 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-0757ed1f-9795-4481-bd73-f8e27df8d63f (0757ed1f-9795-4481-bd73-f8e27df8d63f): created successfully Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a6f52-c22e-42c4-81da-f2746c849b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:54 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (272b8656-76fa-4cca-9b69-34a90dfccd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9ce0144f-05ae-4583-802a-de289d7e55e5 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:55 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 1073741824" returned: 0 in 0.534s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:55 devstack sudo[113468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 Aug 20 06:53:55 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:55 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231129549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e235c6151264d2c9c1452dbd1542c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:53Z,use_quota=True,user_id='f5ae2b62396f43f696b48730bd8e9f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Creating volume a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:55 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca1a358-52e2-4f83-9e17-694f8c2bca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecccf188-5ef7-4993-94dc-f246631fbdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:55 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 1073741824 Aug 20 06:53:55 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 (d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6): created successfully Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecccf188-5ef7-4993-94dc-f246631fbdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (cab64c86-c7fc-4b8a-b3af-17014adad67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-25b4070d-71d0-4fad-b8e7-49727280f594 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:55 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 1073741824" returned: 0 in 0.596s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:56 devstack sudo[113477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 Aug 20 06:53:56 devstack sudo[113477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:56 devstack sudo[113477]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" returned: 0 in 0.277s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fc1b8d-8844-4ef6-951d-f90c2983ac68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1946c2ae7a6943e5a9c6607c3270b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:54Z,use_quota=True,user_id='0fd912899fa54ee5b6fb232caff4f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Creating volume 63fc1b8d-8844-4ef6-951d-f90c2983ac68 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:56 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0005122-b79d-4f7a-9418-0d4dfeb08b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:56 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 1073741824 Aug 20 06:53:56 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3cc596-5c41-42ed-819c-300823b4eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:56 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Volume volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 (a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17): created successfully Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3cc596-5c41-42ed-819c-300823b4eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Flow 'volume_create_manager' (0bef61d2-56de-4a86-a2b6-f84960c67975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:56 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3cb7d5ec-1372-478e-bec3-e9331e0f7a4d tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created volume successfully. Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e4be80-fdfd-4a8a-84bc-85734f724e79]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:57 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 1073741824" returned: 0 in 0.755s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:57 devstack sudo[113522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 Aug 20 06:53:57 devstack sudo[113522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:57 devstack sudo[113521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 Aug 20 06:53:57 devstack sudo[113521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:57 devstack sudo[113522]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68" returned: 0 in 0.388s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:57 devstack sudo[113521]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c14a780-bf65-44ef-bd57-a106132f2307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61319aa1-c7ce-466f-8cd0-b2ab726232cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" returned: 0 in 0.503s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:57 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Volume volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 (63fc1b8d-8844-4ef6-951d-f90c2983ac68): created successfully Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61319aa1-c7ce-466f-8cd0-b2ab726232cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:57 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17 Aug 20 06:53:57 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Flow 'volume_create_manager' (1f0c1712-0eb6-4286-9c12-d44086fe5b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:57 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a46f3895-063f-4c58-b043-4900d400ca1a tempest-CinderUnicodeTest-1294247428 None] Created volume successfully. Aug 20 06:53:57 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" returned: 0 in 0.313s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17" released by "delete_volume" :: held 0.876s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:57 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['5529baf3-c3b3-4b5b-80fd-87c31c10c334', '8aec402d-3383-4a60-a786-2ec6721a12d1', '71e20012-7d4b-42e4-a512-d5e121222181', '00e87579-4637-412e-a41b-2997b2b95abe'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:58 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:58 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0282f3-0092-492e-8b49-7dbb9c42dd77]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:58 devstack sudo[113535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 Aug 20 06:53:58 devstack sudo[113535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:58 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.623s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Flow 'volume_create_manager' (47e012ee-68ee-4856-8d64-6dd2bd0d4101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfebe911-109c-49e7-909d-f2d0088f1607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfebe911-109c-49e7-909d-f2d0088f1607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1586462191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e14b43-25e2-44bf-8444-f4926b08948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1946c2ae7a6943e5a9c6607c3270b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:59Z,use_quota=True,user_id='0fd912899fa54ee5b6fb232caff4f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d76d1-0551-4e67-a794-07fe7fc51d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d76d1-0551-4e67-a794-07fe7fc51d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2156f16-a282-4a48-a77f-491fbae1b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2156f16-a282-4a48-a77f-491fbae1b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e14b43-25e2-44bf-8444-f4926b08948c', 'volume_name': 'volume-a1e14b43-25e2-44bf-8444-f4926b08948c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8663f8b-012a-4363-93cf-0499564ba0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8663f8b-012a-4363-93cf-0499564ba0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933056aa-c942-4686-8a02-f7d8af700d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:58 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Volume a1e14b43-25e2-44bf-8444-f4926b08948c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e14b43-25e2-44bf-8444-f4926b08948c', 'volume_size': 1} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:53:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1586462191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e14b43-25e2-44bf-8444-f4926b08948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1946c2ae7a6943e5a9c6607c3270b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:53:59Z,use_quota=True,user_id='0fd912899fa54ee5b6fb232caff4f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Creating volume a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:53:58 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d78e01a9-eeae-42a6-a166-5ac2f3396f52 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-a9c6c2b4-67bc-4d7e-a600-ed28ccad5d17-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:58 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c 1073741824 Aug 20 06:53:58 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:58 devstack sudo[113535]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" returned: 0 in 0.643s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:58 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6 Aug 20 06:53:58 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:59 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" returned: 0 in 0.399s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6" released by "delete_volume" :: held 1.125s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['db40f48f-d253-4ef0-8595-e4975d6f246c', '9670cf44-ffb5-430d-9059-fcaa7f9d6e87', '5c3ae037-0301-40a8-9256-476c868dee67', '94948ac3-b84f-4d2b-a165-27939e61cb39'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:59 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c 1073741824" returned: 0 in 0.720s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:59 devstack sudo[113551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:53:59 devstack sudo[113551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:53:59 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c Aug 20 06:53:59 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:53:59 devstack sudo[113551]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.342s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:53:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d719ca6c-6362-49e7-8138-ea446f20bffe tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-d4b87cfe-e5c0-4fbd-9bc9-bbf9fb5227d6-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:53:59 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c" returned: 0 in 0.332s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933056aa-c942-4686-8a02-f7d8af700d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e14b43-25e2-44bf-8444-f4926b08948c', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f112f4-a54d-4567-b6b4-a0d592a715b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:53:59 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Volume volume-a1e14b43-25e2-44bf-8444-f4926b08948c (a1e14b43-25e2-44bf-8444-f4926b08948c): created successfully Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f112f4-a54d-4567-b6b4-a0d592a715b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:53:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Flow 'volume_create_manager' (47e012ee-68ee-4856-8d64-6dd2bd0d4101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:53:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fd9b5e3e-0e27-4277-8701-6711fcfd6183 tempest-CinderUnicodeTest-1294247428 None] Created volume successfully. Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-0757ed1f-9795-4481-bd73-f8e27df8d63f-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-0757ed1f-9795-4481-bd73-f8e27df8d63f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-0757ed1f-9795-4481-bd73-f8e27df8d63f" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-0757ed1f-9795-4481-bd73-f8e27df8d63f" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[042aa248-c758-420c-bc63-946f16989511]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:00 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f Aug 20 06:54:00 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:00 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:00 devstack sudo[113562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f Aug 20 06:54:00 devstack sudo[113562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:01 devstack sudo[113562]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0757ed1f-9795-4481-bd73-f8e27df8d63f" returned: 0 in 0.280s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-0757ed1f-9795-4481-bd73-f8e27df8d63f" released by "delete_volume" :: held 0.705s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['7e29dbe9-bae4-4ee0-a243-19a3d7203d7e', '40e7e8d1-fac5-451b-9827-1838cf6458db', '695d55b4-256f-4675-ba68-ab00e264c445', 'af03ad84-920a-4358-98ce-6288f88a9802'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Creating offline snapshot dd26e047-b441-4b1a-b250-e83c61a34271 of volume a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbcc786-52df-4b38-a6e5-186b328eed2f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:01 devstack sudo[113566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:01 devstack sudo[113566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:01 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c Aug 20 06:54:01 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-2c7d287c-9af9-42bc-9b03-12a9c03d71c3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:01 devstack sudo[113566]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-2c7d287c-9af9-42bc-9b03-12a9c03d71c3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.347s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d038b5b5-7448-4021-a498-1ce7f8a82c46 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-0757ed1f-9795-4481-bd73-f8e27df8d63f-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:01 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c" returned: 0 in 0.500s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180340e-128e-46c7-a81a-7614fd80aa9e]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:01 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 1G Aug 20 06:54:01 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:02 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 Aug 20 06:54:02 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:02 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" returned: 0 in 0.515s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:02 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3 Aug 20 06:54:02 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:02 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 1G" returned: 0 in 0.566s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e14b43-25e2-44bf-8444-f4926b08948c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:02 devstack sudo[113592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e14b43-25e2-44bf-8444-f4926b08948c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 Aug 20 06:54:02 devstack sudo[113592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:02 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-2c7d287c-9af9-42bc-9b03-12a9c03d71c3" released by "delete_volume" :: held 0.861s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['aea6946e-d352-4c94-b4fc-d08a71e4d13e', '5def6c27-e062-486d-aba7-b5eee46cd9c7', '1044c20d-3e89-4c9a-97a9-984f30d58f3c', 'c32b6224-d488-44e6-847e-51c018ee7c3c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:02 devstack sudo[113592]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e14b43-25e2-44bf-8444-f4926b08948c -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271" returned: 0 in 0.324s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:02 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 is being set with open permissions: ugo+rw Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:02 devstack sudo[113599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 Aug 20 06:54:02 devstack sudo[113599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:02 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:02 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-977de959-e61f-45e1-bc12-2f023c4222f3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-977de959-e61f-45e1-bc12-2f023c4222f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-977de959-e61f-45e1-bc12-2f023c4222f3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-977de959-e61f-45e1-bc12-2f023c4222f3" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:03 devstack sudo[113599]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271" returned: 0 in 0.277s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e67cb5-d882-4c7b-92cb-138c17a41488]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:03 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info Aug 20 06:54:03 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:03 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:54:03 devstack sudo[113604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 Aug 20 06:54:03 devstack sudo[113604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-139a6777-eca4-4258-b6d9-27e119dc61ee tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-2c7d287c-9af9-42bc-9b03-12a9c03d71c3-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:03 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info" returned: 0 in 0.291s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info is being set with open permissions: ugo+rw Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:03 devstack sudo[113611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info Aug 20 06:54:03 devstack sudo[113611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:03 devstack sudo[113604]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3" returned: 0 in 0.431s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:03 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3 Aug 20 06:54:03 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:03 devstack sudo[113611]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.info" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-03649208-494e-42ad-a88c-7b5c3ca64e88 tempest-CinderUnicodeTest-1294247428 None] Create snapshot completed successfully Aug 20 06:54:03 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-977de959-e61f-45e1-bc12-2f023c4222f3" returned: 0 in 0.309s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-977de959-e61f-45e1-bc12-2f023c4222f3" released by "delete_volume" :: held 0.804s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['68397715-1878-4b0a-a6ce-2c9cfdea3497', '02717101-ee21-4149-b0b4-8bceec454bb4', 'd24886ca-bd50-4d20-91c1-dd37d9088f4c', '5dc340a5-97fa-4e56-a60a-47418589a0e9'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:04 devstack sudo[113619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:04 devstack sudo[113619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-7c547b9c-4111-471c-ae38-939fdd73966b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-7c547b9c-4111-471c-ae38-939fdd73966b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-7c547b9c-4111-471c-ae38-939fdd73966b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-7c547b9c-4111-471c-ae38-939fdd73966b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleting offline snapshot 7c547b9c-4111-471c-ae38-939fdd73966b of volume fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] snapshot_file for this snap is: volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f2fbf-0417-4fba-bacb-131cbec3fb58]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:04 devstack sudo[113619]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.409s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:04 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8872d092-7303-4a66-a50b-ea8113c08e9b tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-977de959-e61f-45e1-bc12-2f023c4222f3-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:04 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b Aug 20 06:54:04 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-dd26e047-b441-4b1a-b250-e83c61a34271-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-dd26e047-b441-4b1a-b250-e83c61a34271-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-quobyte-dd26e047-b441-4b1a-b250-e83c61a34271" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-dd26e047-b441-4b1a-b250-e83c61a34271" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Deleting offline snapshot dd26e047-b441-4b1a-b250-e83c61a34271 of volume a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] snapshot_file for this snap is: volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d709047-0d4c-49c8-9e59-e804ef710c39]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:04 devstack sudo[113624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 Aug 20 06:54:04 devstack sudo[113624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:04 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b" returned: 0 in 0.529s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae49280-c49a-43bc-818b-78e5acd50d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93cb1db-0c16-448a-8194-8062eb295467]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:05 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 Aug 20 06:54:05 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:05 devstack sudo[113624]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271" returned: 0 in 0.526s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e14b43-25e2-44bf-8444-f4926b08948c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fc8da-2038-41cf-944e-1143bb81ac12]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:05 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c Aug 20 06:54:05 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:05 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53" returned: 0 in 0.593s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:05 devstack sudo[113642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b Aug 20 06:54:05 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:05 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c" returned: 0 in 0.559s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:05 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 Aug 20 06:54:05 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:06 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b" returned: 0 in 0.493s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:06 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b Aug 20 06:54:06 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:06 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53.7c547b9c-4111-471c-ae38-939fdd73966b" returned: 0 in 0.352s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:06 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271" returned: 0 in 0.555s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-7c547b9c-4111-471c-ae38-939fdd73966b" released by "_delete_snapshot" :: held 2.128s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" released by "delete_snapshot" :: held 2.162s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:06 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271 Aug 20 06:54:06 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['40f4023d-adc5-410d-957c-0e40d576a088', 'e90be8c8-d837-4b71-9f5b-4aaf83e80d9b', '8301aca6-ca7a-48d0-8af9-eea39a7a4d9d', '83880984-0a17-440a-85e5-796258e2e341'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Delete snapshot completed successfully. Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e59e45db-b239-4678-b9fb-9d726204e4e1 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-7c547b9c-4111-471c-ae38-939fdd73966b-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:06 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c.dd26e047-b441-4b1a-b250-e83c61a34271" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-dd26e047-b441-4b1a-b250-e83c61a34271" released by "_delete_snapshot" :: held 2.114s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" released by "delete_snapshot" :: held 2.140s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Created reservations ['1a2020f2-a5d6-4c04-a022-b8896e2f4cb0', '5f88f8ab-f1df-4f31-aba5-7e0f1ea6759a', '1f00da53-aa0f-487c-a60a-1e8b237f6f23', 'f5b13ada-8e1a-46b3-9421-345a51b256fc'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Delete snapshot completed successfully. Aug 20 06:54:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-774b2301-a29f-4237-a51a-070f30bccc89 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-dd26e047-b441-4b1a-b250-e83c61a34271-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-fae49280-c49a-43bc-818b-78e5acd50d53-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-fae49280-c49a-43bc-818b-78e5acd50d53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b7600-6a80-40d6-bf64-202917d512a7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:07 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 Aug 20 06:54:07 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-a1e14b43-25e2-44bf-8444-f4926b08948c-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-a1e14b43-25e2-44bf-8444-f4926b08948c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da382e-2a2f-4746-9895-fb091614a7c3]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:08 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53" returned: 0 in 0.521s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:08 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c Aug 20 06:54:08 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:08 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53 Aug 20 06:54:08 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:08 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-fae49280-c49a-43bc-818b-78e5acd50d53" returned: 0 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:08 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c" returned: 0 in 0.492s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-quobyte-fae49280-c49a-43bc-818b-78e5acd50d53" released by "delete_volume" :: held 0.948s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:08 devstack sudo[113676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c Aug 20 06:54:08 devstack sudo[113676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Created reservations ['fcbc5adb-1806-4e28-9820-7e468918ee06', '3e9cd0dd-e763-4301-abb1-a2df6bbcda54', '873c7d17-fcce-4d12-9a81-76479e029522', 'b9ba43c6-3967-420d-90ae-a7d01972a243'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:08 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:08 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:08 devstack sudo[113676]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-a1e14b43-25e2-44bf-8444-f4926b08948c" returned: 0 in 0.344s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-a1e14b43-25e2-44bf-8444-f4926b08948c" released by "delete_volume" :: held 0.917s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Created reservations ['a44167a7-74db-4814-8d2f-fc73753d2800', '850cc586-1210-4c11-873e-676e5bbe0f2d', 'eced7ab4-c37d-4feb-846a-e64d75bdd8d6', 'f0045851-ecc4-4cde-96c0-508228567d58'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:09 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.412s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:09 devstack sudo[113682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:09 devstack sudo[113682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Deleted volume successfully. Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-18d00f4c-ac9f-4424-b080-6b02303264e3 tempest-CreateVolumesFromSnapshotTest-1309243408 None] Lock "cinder-fae49280-c49a-43bc-818b-78e5acd50d53-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-63fc1b8d-8844-4ef6-951d-f90c2983ac68-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:09 devstack sudo[113682]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Deleted volume successfully. Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-63fc1b8d-8844-4ef6-951d-f90c2983ac68-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9c0b9e13-bdeb-4057-9032-497ee5a65935 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-a1e14b43-25e2-44bf-8444-f4926b08948c-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "cinder-quobyte-63fc1b8d-8844-4ef6-951d-f90c2983ac68" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-63fc1b8d-8844-4ef6-951d-f90c2983ac68" acquired by "delete_volume" :: waited 0.042s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Flow 'volume_create_manager' (10d3faf0-1b9f-4c1d-a4f4-75d3210a493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6de0b6-429e-4ef0-b99c-1fd8f9cfee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a8bf1-c8ec-4af1-9360-f55010145183]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6de0b6-429e-4ef0-b99c-1fd8f9cfee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833904137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cb549a-4e76-4950-b9e7-5042e87575b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1e231e46424fd19c04cdffd794017d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:10Z,use_quota=True,user_id='ab45d57e78204b54abc5fef2adee6bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2c0f7-85f3-43c5-868f-a007991b2339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2c0f7-85f3-43c5-868f-a007991b2339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60047ab0-a7b0-4dd3-aa2a-92952f6f0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60047ab0-a7b0-4dd3-aa2a-92952f6f0b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cb549a-4e76-4950-b9e7-5042e87575b3', 'volume_name': 'volume-c4cb549a-4e76-4950-b9e7-5042e87575b3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f0d5a2-f9e5-48eb-bbb6-d2e20f385bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f0d5a2-f9e5-48eb-bbb6-d2e20f385bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faebe846-526e-4e0e-aaf7-a81838c2e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Volume c4cb549a-4e76-4950-b9e7-5042e87575b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cb549a-4e76-4950-b9e7-5042e87575b3', 'volume_size': 1} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833904137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cb549a-4e76-4950-b9e7-5042e87575b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1e231e46424fd19c04cdffd794017d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:10Z,use_quota=True,user_id='ab45d57e78204b54abc5fef2adee6bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Creating volume c4cb549a-4e76-4950-b9e7-5042e87575b3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:09 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 1073741824 Aug 20 06:54:09 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:09 devstack sudo[113685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 Aug 20 06:54:09 devstack sudo[113685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:10 devstack sudo[113685]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68" returned: 0 in 0.447s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:10 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68 Aug 20 06:54:10 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:10 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 1073741824" returned: 0 in 0.539s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:10 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 Aug 20 06:54:10 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:10 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-63fc1b8d-8844-4ef6-951d-f90c2983ac68" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-quobyte-63fc1b8d-8844-4ef6-951d-f90c2983ac68" released by "delete_volume" :: held 0.860s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Created reservations ['14768ceb-5e79-47b5-96cf-5b17a0e661f0', 'b3cef7ed-c45b-4448-afbb-0d168a58318f', 'aa9aa3fb-c439-4e4b-b91b-a548d028563b', '21c528bd-262a-49b3-87b8-861cf12702fe'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:10 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:10 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:10 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3" returned: 0 in 0.394s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faebe846-526e-4e0e-aaf7-a81838c2e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cb549a-4e76-4950-b9e7-5042e87575b3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3727eb70-6ae7-4b82-a832-0b942cef251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:10 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Volume volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 (c4cb549a-4e76-4950-b9e7-5042e87575b3): created successfully Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3727eb70-6ae7-4b82-a832-0b942cef251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Flow 'volume_create_manager' (10d3faf0-1b9f-4c1d-a4f4-75d3210a493e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8a1e5e26-c81e-4570-bf15-1753cb43a018 tempest-ProjectReaderTests-775553330 None] Created volume successfully. Aug 20 06:54:10 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:10 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Deleted volume successfully. Aug 20 06:54:10 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-06b39ce8-519b-4705-86a6-95c43a52e009 tempest-CinderUnicodeTest-1294247428 None] Lock "cinder-63fc1b8d-8844-4ef6-951d-f90c2983ac68-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Acquiring lock "cinder-c4cb549a-4e76-4950-b9e7-5042e87575b3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "cinder-c4cb549a-4e76-4950-b9e7-5042e87575b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:11 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Acquiring lock "cinder-quobyte-c4cb549a-4e76-4950-b9e7-5042e87575b3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "cinder-quobyte-c4cb549a-4e76-4950-b9e7-5042e87575b3" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353522a-d844-4fdb-8fb0-ac03a33cda7a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:12 devstack sudo[113705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 Aug 20 06:54:12 devstack sudo[113705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:12 devstack sudo[113705]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3" returned: 0 in 0.400s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:12 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3 Aug 20 06:54:12 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:12 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-c4cb549a-4e76-4950-b9e7-5042e87575b3" returned: 0 in 0.321s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "cinder-quobyte-c4cb549a-4e76-4950-b9e7-5042e87575b3" released by "delete_volume" :: held 0.777s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Created reservations ['07afce53-3df7-47e3-9f91-95abae28f042', 'dd77f874-4482-466f-beae-9295e0137a28', 'bf6e0d02-0be3-4354-b72f-cdbce07bdff5', '96b27e04-0341-4715-949d-89f570c2e58c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:12 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:12 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:13 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.492s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Deleted volume successfully. Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-c3e54c05-54e9-4646-a46e-33900f78aa4a tempest-ProjectReaderTests-775553330 None] Lock "cinder-c4cb549a-4e76-4950-b9e7-5042e87575b3-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (9926f96e-b332-4fb4-8e85-1bcb0ce4cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b3cfb7-f20c-4dd0-9ef3-ff5bd51ed5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b3cfb7-f20c-4dd0-9ef3-ff5bd51ed5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254191625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bbcd76-7867-47a5-b340-c46b443ee73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:14Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51f7627-2dd6-43b7-ad93-005b6dce289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51f7627-2dd6-43b7-ad93-005b6dce289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54f3a97-c675-4f06-8e33-202da4f9f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54f3a97-c675-4f06-8e33-202da4f9f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bbcd76-7867-47a5-b340-c46b443ee73e', 'volume_name': 'volume-e1bbcd76-7867-47a5-b340-c46b443ee73e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579cf9ab-3fc4-4e4f-82b5-754d1030a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579cf9ab-3fc4-4e4f-82b5-754d1030a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb224b0-413e-4782-8574-1d0d21178d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:13 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Volume e1bbcd76-7867-47a5-b340-c46b443ee73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bbcd76-7867-47a5-b340-c46b443ee73e', 'volume_size': 1} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254191625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bbcd76-7867-47a5-b340-c46b443ee73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:14Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Creating volume e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:13 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:13 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e 1073741824 Aug 20 06:54:13 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Flow 'volume_create_manager' (2e6e6b96-6b25-4e9b-8f0b-5baa662dbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:13 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e514730-5eae-4235-a769-7670715a56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e514730-5eae-4235-a769-7670715a56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039659810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04be2e6f-3ea7-4693-9e9c-4a34e5731437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1e231e46424fd19c04cdffd794017d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:14Z,use_quota=True,user_id='ab45d57e78204b54abc5fef2adee6bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548febee-f1a1-4138-bfea-2809141e4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548febee-f1a1-4138-bfea-2809141e4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039121e-dd6e-4c0b-958c-67fdb1f5a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039121e-dd6e-4c0b-958c-67fdb1f5a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04be2e6f-3ea7-4693-9e9c-4a34e5731437', 'volume_name': 'volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83673419-a294-4f84-a24b-eb02dd916294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83673419-a294-4f84-a24b-eb02dd916294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad14b34-2621-4c34-a142-a154fb9d0e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Volume 04be2e6f-3ea7-4693-9e9c-4a34e5731437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437', 'volume_size': 1} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:14 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e 1073741824" returned: 0 in 0.625s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:14 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e Aug 20 06:54:14 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:14 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e" returned: 0 in 0.258s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039659810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04be2e6f-3ea7-4693-9e9c-4a34e5731437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1e231e46424fd19c04cdffd794017d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:14Z,use_quota=True,user_id='ab45d57e78204b54abc5fef2adee6bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Creating volume 04be2e6f-3ea7-4693-9e9c-4a34e5731437 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:14 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb224b0-413e-4782-8574-1d0d21178d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bbcd76-7867-47a5-b340-c46b443ee73e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e6c86e-18a4-49d5-a4f4-7ce99634cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:14 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 1073741824 Aug 20 06:54:14 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:14 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Volume volume-e1bbcd76-7867-47a5-b340-c46b443ee73e (e1bbcd76-7867-47a5-b340-c46b443ee73e): created successfully Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e6c86e-18a4-49d5-a4f4-7ce99634cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:14 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (9926f96e-b332-4fb4-8e85-1bcb0ce4cd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-755ae608-7fc1-4a29-b43d-984d0528e7de tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:54:15 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 1073741824" returned: 0 in 0.458s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:15 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 Aug 20 06:54:15 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:15 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437" returned: 0 in 0.286s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad14b34-2621-4c34-a142-a154fb9d0e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f7c859-0a23-4e9b-8268-69eecdd03912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:15 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Volume volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 (04be2e6f-3ea7-4693-9e9c-4a34e5731437): created successfully Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f7c859-0a23-4e9b-8268-69eecdd03912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Flow 'volume_create_manager' (2e6e6b96-6b25-4e9b-8f0b-5baa662dbe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c286b1d3-4c84-42a8-b54a-c93315fb6494 tempest-ProjectReaderTests-775553330 None] Created volume successfully. Aug 20 06:54:15 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-48fb5444-56a7-4b13-b0d3-843c03784325 tempest-ProjectAdminTests-18304455 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.341567993164, 'free_capacity_gb': 1775.341567993164, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Acquiring lock "cinder-04be2e6f-3ea7-4693-9e9c-4a34e5731437-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "cinder-04be2e6f-3ea7-4693-9e9c-4a34e5731437-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Acquiring lock "cinder-quobyte-04be2e6f-3ea7-4693-9e9c-4a34e5731437" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "cinder-quobyte-04be2e6f-3ea7-4693-9e9c-4a34e5731437" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e85c8-5b8b-43a1-9a67-a84780424c0a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:16 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 Aug 20 06:54:16 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot 9f1bbce1-db68-4c4c-a364-a511a5254350 of volume e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:16 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437" returned: 0 in 0.488s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e13bf-4223-4089-b0b7-15ea1090b37f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:16 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437 Aug 20 06:54:16 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:16 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e Aug 20 06:54:16 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:16 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-04be2e6f-3ea7-4693-9e9c-4a34e5731437" returned: 0 in 0.309s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "cinder-quobyte-04be2e6f-3ea7-4693-9e9c-4a34e5731437" released by "delete_volume" :: held 0.845s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Created reservations ['740f92fc-49f4-4686-a8eb-291ac3da3136', '87e3fb27-48c1-498e-a915-c7086c71525d', '7e4b865a-debb-4cc1-9958-121ae7d26185', '363b5c37-b410-4bf8-9233-7f94bbd09c4d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:17 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e" returned: 0 in 0.508s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:17 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 1G Aug 20 06:54:17 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:17 devstack sudo[113749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:17 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:17 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.514s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Deleted volume successfully. Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=299,cinder:SELECT=219,cinder:INSERT=82,cinder:DELETE=20 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:54:17 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-99d5b270-441e-4d44-8747-86c0827f62a0 tempest-ProjectReaderTests-775553330 None] Lock "cinder-04be2e6f-3ea7-4693-9e9c-4a34e5731437-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 1G" returned: 0 in 0.713s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bbcd76-7867-47a5-b340-c46b443ee73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:17 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bbcd76-7867-47a5-b340-c46b443ee73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 Aug 20 06:54:17 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:18 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bbcd76-7867-47a5-b340-c46b443ee73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350" returned: 0 in 0.357s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 is being set with open permissions: ugo+rw Aug 20 06:54:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:18 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 Aug 20 06:54:18 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:18 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:18 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=219,cinder:UPDATE=307,cinder:DELETE=34,cinder:INSERT=78 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:54:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:18 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info Aug 20 06:54:18 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:19 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:19 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info is being set with open permissions: ugo+rw Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:19 devstack sudo[113768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info Aug 20 06:54:19 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:19 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.info" returned: 0 in 0.310s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a4d88fe4-73db-464c-ba24-c04d4de79ae1 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-9f1bbce1-db68-4c4c-a364-a511a5254350-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-9f1bbce1-db68-4c4c-a364-a511a5254350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-9f1bbce1-db68-4c4c-a364-a511a5254350" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-9f1bbce1-db68-4c4c-a364-a511a5254350" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot 9f1bbce1-db68-4c4c-a364-a511a5254350 of volume e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898827d-3829-442f-945d-86b6f3018bd4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:20 devstack sudo[113771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 Aug 20 06:54:20 devstack sudo[113771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:20 devstack sudo[113771]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350" returned: 0 in 0.485s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bbcd76-7867-47a5-b340-c46b443ee73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6604dca6-62cd-4c76-a44f-a3df518a90a6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:20 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e Aug 20 06:54:20 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:21 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e" returned: 0 in 0.540s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:21 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 Aug 20 06:54:21 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:21 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350" returned: 0 in 0.498s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:21 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350 Aug 20 06:54:21 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:21 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e.9f1bbce1-db68-4c4c-a364-a511a5254350" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-9f1bbce1-db68-4c4c-a364-a511a5254350" released by "_delete_snapshot" :: held 2.013s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" released by "delete_snapshot" :: held 2.056s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:22 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Created reservations ['a9bb8478-f390-4eb4-96bf-67ee9025326b', '003248d0-f4d9-4fce-8bfd-fc847f719236', 'eb758cf9-f620-4975-b4b1-90edd85b7d90', '33c69aeb-b1b8-4665-acc7-3237bb16e456'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:22 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:54:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d8690ba8-1900-40e5-be7a-acf4fe89a5fc tempest-ProjectMemberTests-375579751 None] Lock "cinder-9f1bbce1-db68-4c4c-a364-a511a5254350-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-e1bbcd76-7867-47a5-b340-c46b443ee73e-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e1bbcd76-7867-47a5-b340-c46b443ee73e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" acquired by "delete_volume" :: waited 0.031s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[30728898-335d-44ae-9f55-883aaf1420eb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:23 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e Aug 20 06:54:23 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:23 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e" returned: 0 in 0.444s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:23 devstack sudo[113797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e Aug 20 06:54:23 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:24 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e1bbcd76-7867-47a5-b340-c46b443ee73e" returned: 0 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e1bbcd76-7867-47a5-b340-c46b443ee73e" released by "delete_volume" :: held 0.858s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Created reservations ['7420cd0a-849c-4863-88cc-dbbf40ff25f6', '10a3680a-09fb-4a13-85ec-e3f3b98d0cf0', 'ef044910-e461-4947-8ac2-afab4b5bfa9a', '5d26cca5-62e2-477a-bb97-164f40990ce6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:24 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:24 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:24 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.420s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:54:24 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-127741b2-c242-491e-bcf6-d851ae91a184 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e1bbcd76-7867-47a5-b340-c46b443ee73e-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (17e91fe0-da4d-466a-93af-9f31ee9f64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63c63d8-a22f-4c50-a5bc-9188a3920788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63c63d8-a22f-4c50-a5bc-9188a3920788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637272929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e435096-3481-423d-9fbe-ff5954b2045e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:25Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7833e3-95e2-49e4-ad3c-fafdba876399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7833e3-95e2-49e4-ad3c-fafdba876399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6795cfa4-408f-466b-9883-00aff1515b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6795cfa4-408f-466b-9883-00aff1515b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e435096-3481-423d-9fbe-ff5954b2045e', 'volume_name': 'volume-0e435096-3481-423d-9fbe-ff5954b2045e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6ea4f-5335-4d99-bf35-d03179a6c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6ea4f-5335-4d99-bf35-d03179a6c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090db77b-c26e-46ae-8f76-3172f722813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:25 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Volume 0e435096-3481-423d-9fbe-ff5954b2045e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e435096-3481-423d-9fbe-ff5954b2045e', 'volume_size': 1} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637272929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e435096-3481-423d-9fbe-ff5954b2045e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:25Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Creating volume 0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:25 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:25 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e 1073741824 Aug 20 06:54:25 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:26 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e 1073741824" returned: 0 in 0.705s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:26 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e Aug 20 06:54:26 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:26 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090db77b-c26e-46ae-8f76-3172f722813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e435096-3481-423d-9fbe-ff5954b2045e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fcf00-82f0-4f65-8be2-4bfc50e040d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:26 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Volume volume-0e435096-3481-423d-9fbe-ff5954b2045e (0e435096-3481-423d-9fbe-ff5954b2045e): created successfully Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fcf00-82f0-4f65-8be2-4bfc50e040d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:26 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (17e91fe0-da4d-466a-93af-9f31ee9f64cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-af0a9bd8-0461-4094-b758-4803be816456 tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot 4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 of volume 0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff7f3a-ffbb-45fc-9511-ad1d8f3d9363]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:27 devstack sudo[113812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e Aug 20 06:54:27 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (4609d06e-06c4-4711-b713-1a35007ec03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:27 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2c9882-28db-4f59-a881-6007fe70cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2c9882-28db-4f59-a881-6007fe70cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272393053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1238db-df86-4a25-882a-95fb8e374441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:28Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763ce0d1-03d1-4dcc-8bdf-42f114c95b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763ce0d1-03d1-4dcc-8bdf-42f114c95b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b8ec9-d01b-4157-937b-f74a68719f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b8ec9-d01b-4157-937b-f74a68719f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1238db-df86-4a25-882a-95fb8e374441', 'volume_name': 'volume-5a1238db-df86-4a25-882a-95fb8e374441', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115c40b2-079d-4996-b7f7-19d89bdd744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115c40b2-079d-4996-b7f7-19d89bdd744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eeed917-f17e-48c5-a5a5-118bcec0327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:28 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Volume 5a1238db-df86-4a25-882a-95fb8e374441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1238db-df86-4a25-882a-95fb8e374441', 'volume_size': 1} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:28 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e" returned: 0 in 0.580s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:28 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 1G Aug 20 06:54:28 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:28 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 1G" returned: 0 in 0.562s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e435096-3481-423d-9fbe-ff5954b2045e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:28 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e435096-3481-423d-9fbe-ff5954b2045e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 Aug 20 06:54:28 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:29 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e435096-3481-423d-9fbe-ff5954b2045e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" returned: 0 in 0.368s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:29 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 is being set with open permissions: ugo+rw Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:29 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 Aug 20 06:54:29 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:29 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:29 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info Aug 20 06:54:29 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:29 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info" returned: 0 in 0.337s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:29 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info is being set with open permissions: ugo+rw Aug 20 06:54:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:29 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info Aug 20 06:54:29 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:30 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.info" returned: 0 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272393053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1238db-df86-4a25-882a-95fb8e374441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:28Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Creating volume 5a1238db-df86-4a25-882a-95fb8e374441 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:30 devstack sudo[113838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 1073741824 Aug 20 06:54:30 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a8757fe8-846e-4666-87bd-97e087a9b1e5 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:30 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 1073741824" returned: 0 in 0.653s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot 4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 of volume 0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e9d45d-0f7a-4b7a-a57e-63f319c26a8f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:31 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 Aug 20 06:54:31 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:31 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 Aug 20 06:54:31 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:31 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eeed917-f17e-48c5-a5a5-118bcec0327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1238db-df86-4a25-882a-95fb8e374441', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49f079-9382-4c3a-aa58-2e250d55ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Volume volume-5a1238db-df86-4a25-882a-95fb8e374441 (5a1238db-df86-4a25-882a-95fb8e374441): created successfully Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49f079-9382-4c3a-aa58-2e250d55ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (4609d06e-06c4-4711-b713-1a35007ec03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7f82d24c-ad78-4809-9ee8-b60dbafdf4ae tempest-ProjectReaderTests-399037990 None] Created volume successfully. Aug 20 06:54:31 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" returned: 0 in 0.481s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e435096-3481-423d-9fbe-ff5954b2045e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[db396346-5274-47e9-9dd3-c8562173cf2d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:31 devstack sudo[113852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e Aug 20 06:54:31 devstack sudo[113852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:32 devstack sudo[113852]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e" returned: 0 in 0.488s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:32 devstack sudo[113857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 Aug 20 06:54:32 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:32 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" returned: 0 in 0.481s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:32 devstack sudo[113863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0 Aug 20 06:54:32 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-5a1238db-df86-4a25-882a-95fb8e374441-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "cinder-5a1238db-df86-4a25-882a-95fb8e374441-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-quobyte-5a1238db-df86-4a25-882a-95fb8e374441" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-5a1238db-df86-4a25-882a-95fb8e374441" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79670f-3a41-41ed-8a1e-ab6fa1ef7810]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:32 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e.4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" returned: 0 in 0.380s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0" released by "_delete_snapshot" :: held 2.025s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" released by "delete_snapshot" :: held 2.083s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:33 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 Aug 20 06:54:33 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Created reservations ['a048df3f-4006-4c67-866c-cc26fb3cbd8e', '7efa63e2-6abc-480e-ba2a-a447880c951b', 'a08ae79b-2d9b-4193-8fb9-c7d35cb96329', '3aed7857-89db-44e2-94e5-93b75bacb3c4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d3445e40-2ffa-4edb-8396-5447a366b7f5 tempest-ProjectMemberTests-375579751 None] Lock "cinder-4a2ed4b5-8167-4f50-95ea-7f1d4dc829b0-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:33 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441" returned: 0 in 0.497s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:33 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441 Aug 20 06:54:33 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:33 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-5a1238db-df86-4a25-882a-95fb8e374441" returned: 0 in 0.297s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-5a1238db-df86-4a25-882a-95fb8e374441" released by "delete_volume" :: held 0.864s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Created reservations ['adfc8fc4-0be2-44d7-a43c-02bade827682', '4653200f-7c14-4b36-8826-333b2e981654', 'e3907bc0-4c16-48ce-8ebb-2daf69883aa9', '5b78c737-3114-47de-82dd-b418778af0dc'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:33 devstack sudo[113875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:33 devstack sudo[113875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:34 devstack sudo[113875]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.389s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:34 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Deleted volume successfully. Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d52bb499-2333-4f2a-afb0-9badefa7345e tempest-ProjectReaderTests-399037990 None] Lock "cinder-5a1238db-df86-4a25-882a-95fb8e374441-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-0e435096-3481-423d-9fbe-ff5954b2045e-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "cinder-0e435096-3481-423d-9fbe-ff5954b2045e-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:34 devstack sudo[113879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:34 devstack sudo[113879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[240e8aa3-d45f-4b6c-9b24-9d10048e07f2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:34 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e Aug 20 06:54:34 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (a94f42b2-61cc-4ba5-9157-37e57d393a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3372b1b-1243-41ee-a5b1-1af8829d3900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3372b1b-1243-41ee-a5b1-1af8829d3900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610243231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cf631d-9e17-441b-8421-859241a360b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:35Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e17df-0f4d-4671-ac6b-f4531296144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e17df-0f4d-4671-ac6b-f4531296144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6341e35a-0ae2-46e6-85f2-b5b92d4a9925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6341e35a-0ae2-46e6-85f2-b5b92d4a9925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cf631d-9e17-441b-8421-859241a360b3', 'volume_name': 'volume-e9cf631d-9e17-441b-8421-859241a360b3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a9f27e-d19b-49b9-a22a-c035417d6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a9f27e-d19b-49b9-a22a-c035417d6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddb273-819e-422f-8bf8-ed0ae277988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:34 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Volume e9cf631d-9e17-441b-8421-859241a360b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cf631d-9e17-441b-8421-859241a360b3', 'volume_size': 1} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610243231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cf631d-9e17-441b-8421-859241a360b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:35Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Creating volume e9cf631d-9e17-441b-8421-859241a360b3 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:34 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:34 devstack sudo[113879]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.449s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:54:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:54:34 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 1073741824 Aug 20 06:54:34 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:35 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e" returned: 0 in 0.470s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:35 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e Aug 20 06:54:35 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:35 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0e435096-3481-423d-9fbe-ff5954b2045e" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:35 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-0e435096-3481-423d-9fbe-ff5954b2045e" released by "delete_volume" :: held 0.904s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 1073741824" returned: 0 in 0.622s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:35 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 Aug 20 06:54:35 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Created reservations ['99b851d4-f08e-410f-92e2-bb6f8aea93af', 'addfd091-7741-45eb-a113-e017f51a7bbe', '1afaaeda-6068-4a50-a7bd-c03dec1ef5e4', '9c1c8f5c-f8c1-4d28-a2ab-25e09be4900a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:35 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:35 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:35 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3" returned: 0 in 0.317s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddb273-819e-422f-8bf8-ed0ae277988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cf631d-9e17-441b-8421-859241a360b3', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef5806-6de7-46c4-bfaa-24a72a7b99b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:35 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Volume volume-e9cf631d-9e17-441b-8421-859241a360b3 (e9cf631d-9e17-441b-8421-859241a360b3): created successfully Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef5806-6de7-46c4-bfaa-24a72a7b99b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:35 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (a94f42b2-61cc-4ba5-9157-37e57d393a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0b23f022-a78c-4d35-b9a3-9f063b149d12 tempest-ProjectReaderTests-399037990 None] Created volume successfully. Aug 20 06:54:36 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.328s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:36 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5ecd36af-78d6-4fdc-8e22-28de4ce5468c tempest-ProjectMemberTests-375579751 None] Lock "cinder-0e435096-3481-423d-9fbe-ff5954b2045e-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-e9cf631d-9e17-441b-8421-859241a360b3-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "cinder-e9cf631d-9e17-441b-8421-859241a360b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-quobyte-e9cf631d-9e17-441b-8421-859241a360b3" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-e9cf631d-9e17-441b-8421-859241a360b3" acquired by "delete_volume" :: waited 0.029s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[49605c98-c969-4fa3-ab73-60c6e2994d91]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:37 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 Aug 20 06:54:37 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (fdccce2a-5c7f-4c7e-a84c-10f3e12d6bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1623da-4a6b-40e0-b198-7662872c330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1623da-4a6b-40e0-b198-7662872c330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97772361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d611a7-8581-441f-88d5-f8051ee23bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:37Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224650f7-0eed-49fc-a5f1-7ac88d6a1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224650f7-0eed-49fc-a5f1-7ac88d6a1a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275185b8-cb5d-4105-906c-12806f87aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275185b8-cb5d-4105-906c-12806f87aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d611a7-8581-441f-88d5-f8051ee23bfd', 'volume_name': 'volume-e5d611a7-8581-441f-88d5-f8051ee23bfd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfe4b70-1fea-4278-ae48-0471aa3ad200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfe4b70-1fea-4278-ae48-0471aa3ad200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a1a413-f024-4690-b92e-fb807a83d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:37 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Volume e5d611a7-8581-441f-88d5-f8051ee23bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d611a7-8581-441f-88d5-f8051ee23bfd', 'volume_size': 1} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97772361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d611a7-8581-441f-88d5-f8051ee23bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:37Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Creating volume e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:37 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:37 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd 1073741824 Aug 20 06:54:37 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:37 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3" returned: 0 in 0.545s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:37 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3 Aug 20 06:54:37 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:37 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e9cf631d-9e17-441b-8421-859241a360b3" returned: 0 in 0.336s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:37 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd 1073741824" returned: 0 in 0.591s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-e9cf631d-9e17-441b-8421-859241a360b3" released by "delete_volume" :: held 0.989s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:38 devstack sudo[113919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd Aug 20 06:54:38 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Created reservations ['96f4a49c-c8b5-4b34-996a-bb36d3c9a4db', '2a07ab18-8c02-41b9-9121-52aebb6804e7', 'f1be3d0e-e003-416c-aa0d-ba98ea607910', '07c584c8-516d-407a-ab98-ce48d255cff4'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:38 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:38 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:38 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd" returned: 0 in 0.472s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a1a413-f024-4690-b92e-fb807a83d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d611a7-8581-441f-88d5-f8051ee23bfd', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab61c9b4-a4b1-415e-b16c-db3e85f67931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:38 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Volume volume-e5d611a7-8581-441f-88d5-f8051ee23bfd (e5d611a7-8581-441f-88d5-f8051ee23bfd): created successfully Aug 20 06:54:38 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab61c9b4-a4b1-415e-b16c-db3e85f67931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (fdccce2a-5c7f-4c7e-a84c-10f3e12d6bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.338s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Deleted volume successfully. Aug 20 06:54:38 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9584df59-8746-41b7-b545-2e7d2833a95d tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:54:38 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-38462188-36b5-4c5d-bd9e-c523186cff99 tempest-ProjectReaderTests-399037990 None] Lock "cinder-e9cf631d-9e17-441b-8421-859241a360b3-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f of volume e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a8967c-334c-4f88-922c-828bdc09864d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:39 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd Aug 20 06:54:39 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (143867e7-7c8b-4968-a511-24e8a4df59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f7a307-bfa2-45ea-966f-64d12ea64886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f7a307-bfa2-45ea-966f-64d12ea64886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777740959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6a1831-b1bd-45fb-89d3-3c0e9a0702ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:40Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbecabc4-9045-4aad-83a4-f52feeb043c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbecabc4-9045-4aad-83a4-f52feeb043c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b696fe4-a41b-472f-b51e-a77244f2f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b696fe4-a41b-472f-b51e-a77244f2f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6a1831-b1bd-45fb-89d3-3c0e9a0702ae', 'volume_name': 'volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4213d74b-e606-4d51-82b7-616e94afd72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4213d74b-e606-4d51-82b7-616e94afd72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a480c349-9bfc-43bf-9a19-ba4d2ab14d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:39 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Volume df6a1831-b1bd-45fb-89d3-3c0e9a0702ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae', 'volume_size': 1} Aug 20 06:54:39 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:40 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd" returned: 0 in 0.467s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:40 devstack sudo[113930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f 1G Aug 20 06:54:40 devstack sudo[113930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:40 devstack sudo[113930]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f 1G" returned: 0 in 0.446s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d611a7-8581-441f-88d5-f8051ee23bfd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:40 devstack sudo[113936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d611a7-8581-441f-88d5-f8051ee23bfd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f Aug 20 06:54:40 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:40 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d611a7-8581-441f-88d5-f8051ee23bfd -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:40 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f is being set with open permissions: ugo+rw Aug 20 06:54:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:40 devstack sudo[113942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f Aug 20 06:54:40 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:41 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" returned: 0 in 0.290s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:41 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info Aug 20 06:54:41 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:41 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info" returned: 0 in 0.277s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:41 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info is being set with open permissions: ugo+rw Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:41 devstack sudo[113948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info Aug 20 06:54:41 devstack sudo[113948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:41 devstack sudo[113948]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.info" returned: 0 in 0.271s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777740959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6a1831-b1bd-45fb-89d3-3c0e9a0702ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:40Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Creating volume df6a1831-b1bd-45fb-89d3-3c0e9a0702ae {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:41 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:41 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae 1073741824 Aug 20 06:54:41 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ab96fa92-325b-43ba-8e10-cf5e67b50307 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:54:42 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae 1073741824" returned: 0 in 0.487s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:42 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae Aug 20 06:54:42 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:42 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a480c349-9bfc-43bf-9a19-ba4d2ab14d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6333e4d2-3b88-4612-9939-6a9c0d5284aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:42 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Volume volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae (df6a1831-b1bd-45fb-89d3-3c0e9a0702ae): created successfully Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6333e4d2-3b88-4612-9939-6a9c0d5284aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (143867e7-7c8b-4968-a511-24e8a4df59cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:42 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c271fafa-98d2-4cfe-a462-76fdbb64296a tempest-ProjectReaderTests-399037990 None] Created volume successfully. Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f of volume e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8c8be-c566-4131-b537-e15f056f4e1c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:42 devstack sudo[113960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f Aug 20 06:54:42 devstack sudo[113960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "cinder-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-quobyte-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a599301-8ca6-4977-aad7-ca98e0a58e6b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:43 devstack sudo[113960]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" returned: 0 in 0.507s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d611a7-8581-441f-88d5-f8051ee23bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a851f22-c235-43a2-8f46-0af057e369f1]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:43 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae Aug 20 06:54:43 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:43 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd Aug 20 06:54:43 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:43 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" returned: 0 in 0.502s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:43 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae Aug 20 06:54:43 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:43 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd" returned: 0 in 0.543s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:43 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f Aug 20 06:54:43 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:44 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" returned: 0 in 0.374s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae" released by "delete_volume" :: held 0.933s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Created reservations ['a6b22b50-e1b4-43a2-ba88-917adc4d6d8f', '1f7af347-c881-478a-84e7-01aad8963d18', 'ff285aea-68f1-47b5-97b1-c7a0c5a44759', 'caba1823-ef13-4c13-9837-a3349b8af4d3'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:44 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:44 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:44 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" returned: 0 in 0.537s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:44 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f Aug 20 06:54:44 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:44 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.301s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Deleted volume successfully. Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-94fe5db9-e25c-43ed-8608-98a6166fa4e6 tempest-ProjectReaderTests-399037990 None] Lock "cinder-df6a1831-b1bd-45fb-89d3-3c0e9a0702ae-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:44 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd.e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" returned: 0 in 0.298s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f" released by "_delete_snapshot" :: held 2.005s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" released by "delete_snapshot" :: held 2.030s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Created reservations ['79ce4ab2-9af0-46af-a0f5-6aed92705893', 'a129b44a-3547-4b28-88b8-9be4ec544862', '329f92cf-b6f1-4329-b678-8d7b19ada9b5', '81cbb641-5de6-4ef3-84a4-03da30f7968b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:44 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:54:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-9e2b1915-51bf-4b36-93c8-9e10b8aa8487 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e2a37cf8-1bc6-4645-9c90-fdd2f2fbdb2f-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Flow 'volume_create_manager' (a681e5b5-d4fa-4fff-a764-0f55e8a91d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13db81b3-4c8c-4cfe-9283-408bbfb26a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13db81b3-4c8c-4cfe-9283-408bbfb26a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1711731798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb405d2-7f00-46eb-ad6e-dfd81376b73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf62b040cd2f4e8399c8d971947e46f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:45Z,use_quota=True,user_id='a40bee80fa4e46e3bbae0ab187e86dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4977c45-ec1b-4bd0-9611-ff928b3bcfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4977c45-ec1b-4bd0-9611-ff928b3bcfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d16565-5569-4ba9-9461-3f3cc276466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d16565-5569-4ba9-9461-3f3cc276466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb405d2-7f00-46eb-ad6e-dfd81376b73e', 'volume_name': 'volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205911c6-ecd3-4100-a73b-aab9b6b8f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205911c6-ecd3-4100-a73b-aab9b6b8f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08163fe-f3dd-442e-88c9-1904649b23a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Volume 0fb405d2-7f00-46eb-ad6e-dfd81376b73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e', 'volume_size': 1} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1711731798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb405d2-7f00-46eb-ad6e-dfd81376b73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf62b040cd2f4e8399c8d971947e46f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:45Z,use_quota=True,user_id='a40bee80fa4e46e3bbae0ab187e86dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Creating volume 0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:45 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e 1073741824 Aug 20 06:54:45 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:45 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e 1073741824" returned: 0 in 0.433s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:45 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:54:45 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:45 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (0964cc92-a26b-49ae-b721-54dab6689ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b6077a-2af5-43d9-b3ff-e18de38a097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.273s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b6077a-2af5-43d9-b3ff-e18de38a097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131954460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dba003-aa82-4949-a5ad-7bbcd2a4e88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:46Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c199c971-6ad5-491e-b31d-f908027712f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c199c971-6ad5-491e-b31d-f908027712f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e60336b-25ab-4642-937a-2eac730b635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e60336b-25ab-4642-937a-2eac730b635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dba003-aa82-4949-a5ad-7bbcd2a4e88a', 'volume_name': 'volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cfcc18-f8e7-449d-8075-3faffab22099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cfcc18-f8e7-449d-8075-3faffab22099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de22fb4-fd52-4c2d-a742-0012487e1ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Volume 69dba003-aa82-4949-a5ad-7bbcd2a4e88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a', 'volume_size': 1} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131954460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dba003-aa82-4949-a5ad-7bbcd2a4e88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bb84c295e444a1a87130ffd8bdce7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:46Z,use_quota=True,user_id='bfa3e715b60740b0bc02048488fcf9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Creating volume 69dba003-aa82-4949-a5ad-7bbcd2a4e88a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08163fe-f3dd-442e-88c9-1904649b23a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ec971e-907b-48fd-b1d4-b7edf06816d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:45 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a 1073741824 Aug 20 06:54:45 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Volume volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e (0fb405d2-7f00-46eb-ad6e-dfd81376b73e): created successfully Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ec971e-907b-48fd-b1d4-b7edf06816d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Flow 'volume_create_manager' (a681e5b5-d4fa-4fff-a764-0f55e8a91d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-e5d611a7-8581-441f-88d5-f8051ee23bfd-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-6cc77230-8c0b-4cb6-a793-7254f19ea3f3 tempest-SnapshotDependencyTests-1250890520 None] Created volume successfully. Aug 20 06:54:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e5d611a7-8581-441f-88d5-f8051ee23bfd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de7e45c-0482-4ad0-ab5e-4aea9bae465f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:46 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd Aug 20 06:54:46 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:46 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a 1073741824" returned: 0 in 0.469s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:46 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a Aug 20 06:54:46 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:46 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd" returned: 0 in 0.388s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:46 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd Aug 20 06:54:46 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:46 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de22fb4-fd52-4c2d-a742-0012487e1ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a1abf1-90a0-4b7d-aa96-c3274e903656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:46 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Volume volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a (69dba003-aa82-4949-a5ad-7bbcd2a4e88a): created successfully Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a1abf1-90a0-4b7d-aa96-c3274e903656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Flow 'volume_create_manager' (0964cc92-a26b-49ae-b721-54dab6689ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:46 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-aa4b437a-f984-4626-bda8-685ea805a9e7 tempest-ProjectReaderTests-399037990 None] Created volume successfully. Aug 20 06:54:46 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e5d611a7-8581-441f-88d5-f8051ee23bfd" returned: 0 in 0.273s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-e5d611a7-8581-441f-88d5-f8051ee23bfd" released by "delete_volume" :: held 0.724s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Created reservations ['867b7ef0-28db-44ad-b372-aa16517172cd', 'd37e069e-cbc0-41a7-ab0e-03945657da11', '05d25ce5-8de4-4478-b347-eb91fd3afd08', '276f55dd-40a0-4bd9-a3d5-1b1d6b868b1c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:46 devstack sudo[114018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:46 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:47 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.256s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-589ce8d1-14b5-4c7e-badb-fbbf498a03a7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-e5d611a7-8581-441f-88d5-f8051ee23bfd-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Creating offline snapshot 4ce772da-831e-49ce-8e42-7640cd0ba1ad of volume 0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee4ec21-bbf6-4db1-9d2b-c5e2c6e3af76]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:47 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:54:47 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (00083dc3-4c09-4d88-9ae1-637950b7f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62806e2e-c1b0-4ab7-be34-88178562dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62806e2e-c1b0-4ab7-be34-88178562dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333432487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e149429-c47f-430b-a177-281e367f77eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:48Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cefb88-6e54-450c-a4de-11f2cf60d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cefb88-6e54-450c-a4de-11f2cf60d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8b28f-35f5-48f9-bc3c-a324c92c6714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8b28f-35f5-48f9-bc3c-a324c92c6714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e149429-c47f-430b-a177-281e367f77eb', 'volume_name': 'volume-1e149429-c47f-430b-a177-281e367f77eb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31fda88-6ada-450b-90e9-1def360ac168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31fda88-6ada-450b-90e9-1def360ac168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3249864a-d31f-4db4-97c4-c2a94217bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:47 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Volume 1e149429-c47f-430b-a177-281e367f77eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e149429-c47f-430b-a177-281e367f77eb', 'volume_size': 1} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:47 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.382s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:47 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad 1G Aug 20 06:54:47 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-69dba003-aa82-4949-a5ad-7bbcd2a4e88a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "cinder-69dba003-aa82-4949-a5ad-7bbcd2a4e88a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Acquiring lock "cinder-quobyte-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c000326-62fc-4d25-ab4e-9c3b057b32d6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a Aug 20 06:54:48 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:48 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad 1G" returned: 0 in 0.415s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack sudo[114037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:54:48 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:48 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" returned: 0 in 0.416s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a Aug 20 06:54:48 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:48 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.312s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:48 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad is being set with open permissions: ugo+rw Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:54:48 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:48 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" returned: 0 in 0.252s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "cinder-quobyte-69dba003-aa82-4949-a5ad-7bbcd2a4e88a" released by "delete_volume" :: held 0.710s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Created reservations ['ed52cf91-8297-41a9-b8fe-ab38d1018575', '627af018-27cb-4d8c-8c05-4bd5e89d3ab7', '11d305f7-a3dd-4fb4-9f57-b43987605269', '0d00c72e-912e-4af1-986f-a6c2b7174237'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:48 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.262s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:48 devstack sudo[114052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:48 devstack sudo[114052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:48 devstack sudo[114054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info Aug 20 06:54:48 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:49 devstack sudo[114052]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.258s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Deleted volume successfully. Aug 20 06:54:49 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info" returned: 0 in 0.263s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:49 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info is being set with open permissions: ugo+rw Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ca3c737f-0090-47c0-b59e-042ee0cb760c tempest-ProjectReaderTests-399037990 None] Lock "cinder-69dba003-aa82-4949-a5ad-7bbcd2a4e88a-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:49 devstack sudo[114058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info Aug 20 06:54:49 devstack sudo[114058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:49 devstack sudo[114058]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.info" returned: 0 in 0.267s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333432487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e149429-c47f-430b-a177-281e367f77eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:48Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Creating volume 1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:49 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:49 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb 1073741824 Aug 20 06:54:49 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:49 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7ecfc2c6-ff09-4558-b144-2a7efd5ad4b8 tempest-SnapshotDependencyTests-1250890520 None] Create snapshot completed successfully Aug 20 06:54:49 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb 1073741824" returned: 0 in 0.458s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:49 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb Aug 20 06:54:49 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:50 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb" returned: 0 in 0.257s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3249864a-d31f-4db4-97c4-c2a94217bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e149429-c47f-430b-a177-281e367f77eb', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe62bc-ecd8-445c-855d-f95169c3026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:50 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Volume volume-1e149429-c47f-430b-a177-281e367f77eb (1e149429-c47f-430b-a177-281e367f77eb): created successfully Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe62bc-ecd8-445c-855d-f95169c3026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (00083dc3-4c09-4d88-9ae1-637950b7f013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-44ecbccd-7555-4caa-b999-60247a7fe21f tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot f20746a7-840f-4035-9a91-edf65d6a8d29 of volume 1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae11ca0-eea1-4ac3-b3cc-778e48fe67d2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:51 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb Aug 20 06:54:51 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Flow 'volume_create_manager' (bfa19ebf-a41d-4132-a50a-da886ccbf529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137f21cb-f758-4c67-bb8a-423b6925ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137f21cb-f758-4c67-bb8a-423b6925ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b706ae4f-56cd-41fd-8f50-28970cf561d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf62b040cd2f4e8399c8d971947e46f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ce772da-831e-49ce-8e42-7640cd0ba1ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:51Z,use_quota=True,user_id='a40bee80fa4e46e3bbae0ab187e86dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d897cee4-f1d9-4284-8a49-05e6e1cf785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d897cee4-f1d9-4284-8a49-05e6e1cf785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f7a12-c8da-4e3a-88d5-7e1d8ca094f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f7a12-c8da-4e3a-88d5-7e1d8ca094f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b706ae4f-56cd-41fd-8f50-28970cf561d4', 'volume_name': 'volume-b706ae4f-56cd-41fd-8f50-28970cf561d4', 'volume_size': 1, 'snapshot_id': '4ce772da-831e-49ce-8e42-7640cd0ba1ad'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c31a3-639a-47b3-bb51-dc71d2aeb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c31a3-639a-47b3-bb51-dc71d2aeb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba1e0aa-a290-4477-84ab-09b06417974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:51 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Volume b706ae4f-56cd-41fd-8f50-28970cf561d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b706ae4f-56cd-41fd-8f50-28970cf561d4', 'volume_size': 1, 'snapshot_id': '4ce772da-831e-49ce-8e42-7640cd0ba1ad'} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:51 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb" returned: 0 in 0.382s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:51 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 1G Aug 20 06:54:51 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:51 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 1G" returned: 0 in 0.384s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e149429-c47f-430b-a177-281e367f77eb -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:51 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e149429-c47f-430b-a177-281e367f77eb -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 Aug 20 06:54:51 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:52 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e149429-c47f-430b-a177-281e367f77eb -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:52 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 is being set with open permissions: ugo+rw Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:52 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 Aug 20 06:54:52 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:52 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:52 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info Aug 20 06:54:52 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:52 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info" returned: 0 in 0.256s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:52 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info is being set with open permissions: ugo+rw Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:52 devstack sudo[114091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info Aug 20 06:54:52 devstack sudo[114091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:52 devstack sudo[114091]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.info" returned: 0 in 0.234s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.556s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad-b706ae4f-56cd-41fd-8f50-28970cf561d4" by "_create_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad-b706ae4f-56cd-41fd-8f50-28970cf561d4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Creating volume b706ae4f-56cd-41fd-8f50-28970cf561d4 from snapshot 4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" by "_copy_volume_from_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-441c1f97-d8be-4d5c-b0e2-b1b1c3014a91 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] snapshot: 4ce772da-831e-49ce-8e42-7640cd0ba1ad, volume: b706ae4f-56cd-41fd-8f50-28970cf561d4, {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0953cd-14c4-47d9-a180-f0e8eb084a39]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:54:53 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-f20746a7-840f-4035-9a91-edf65d6a8d29-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-f20746a7-840f-4035-9a91-edf65d6a8d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-f20746a7-840f-4035-9a91-edf65d6a8d29" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-f20746a7-840f-4035-9a91-edf65d6a8d29" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot f20746a7-840f-4035-9a91-edf65d6a8d29 of volume 1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522b4c7-da64-419b-92a0-c3827e79db8b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 Aug 20 06:54:53 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:53 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.378s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e9f84-0c89-47be-967b-4a6b650344df]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:54:53 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:53 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29" returned: 0 in 0.388s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e149429-c47f-430b-a177-281e367f77eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66129f4-9c8a-44ab-9e4c-f3552d15b7ad]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Creating direct copy from snapshot {{(pid=94234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG cinder.utils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Path /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 not found in is_blk_device check {{(pid=94234) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb Aug 20 06:54:53 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:53 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 Aug 20 06:54:53 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:53 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb" returned: 0 in 0.371s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:53 devstack sudo[114119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 Aug 20 06:54:53 devstack sudo[114119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:54 devstack sudo[114119]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29" returned: 0 in 0.602s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:54 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29 Aug 20 06:54:54 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:55 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb.f20746a7-840f-4035-9a91-edf65d6a8d29" returned: 0 in 0.620s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-f20746a7-840f-4035-9a91-edf65d6a8d29" released by "_delete_snapshot" :: held 2.150s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" released by "delete_snapshot" :: held 2.184s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:55 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Created reservations ['4c8ae8d9-ae93-4f16-a8cf-dc7e2d3b5e0b', '34d340a3-acde-4ba0-9eaa-06fea569ebfb', '195677be-fc33-452d-86c3-716747648557', 'ea612b75-b01e-48d9-b5ba-ae705129eaf6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:54:55 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5c5124c6-5c6e-475e-bbfc-7ca5eaaf4a01 tempest-ProjectMemberTests-375579751 None] Lock "cinder-f20746a7-840f-4035-9a91-edf65d6a8d29-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-1e149429-c47f-430b-a177-281e367f77eb-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-1e149429-c47f-430b-a177-281e367f77eb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" acquired by "delete_volume" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6accfc-ab3e-438f-92ff-f8f34b8c25bc]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:56 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb Aug 20 06:54:56 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:57 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb" returned: 0 in 0.769s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:57 devstack sudo[114173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb Aug 20 06:54:57 devstack sudo[114173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:58 devstack sudo[114173]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1e149429-c47f-430b-a177-281e367f77eb" returned: 0 in 0.607s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-1e149429-c47f-430b-a177-281e367f77eb" released by "delete_volume" :: held 1.513s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Created reservations ['7120df57-01d7-4298-a0b0-52913a584341', 'e8361de2-9ad9-4238-bdbd-903d2dbea01b', 'd6d434f6-0d46-4e15-aea3-1940e9668f79', 'a9033acd-2181-4ee0-aab1-306484f7674f'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:58 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:54:58 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:58 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4" returned: 0 in 4.883s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.image.image_utils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Image conversion details: src /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 {{(pid=94234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 20 06:54:58 devstack cinder-volume[94234]: INFO cinder.image.image_utils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Converted 1024.00 MB image at 209.64 MB/s Aug 20 06:54:58 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 is being set with open permissions: ugo+rw Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:58 devstack sudo[114181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 Aug 20 06:54:58 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:58 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.328s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:54:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-3c96734a-5b7a-4858-8c1a-52d5d7da1fe7 tempest-ProjectMemberTests-375579751 None] Lock "cinder-1e149429-c47f-430b-a177-281e367f77eb-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:58 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4" returned: 0 in 0.281s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" released by "_copy_volume_from_snapshot" :: held 6.002s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad-b706ae4f-56cd-41fd-8f50-28970cf561d4" released by "_create_volume_from_snapshot" :: held 6.068s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.088s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba1e0aa-a290-4477-84ab-09b06417974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b706ae4f-56cd-41fd-8f50-28970cf561d4', 'volume_size': 1, 'snapshot_id': '4ce772da-831e-49ce-8e42-7640cd0ba1ad'}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855b99c9-e386-413e-a793-4dd90b4af11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:58 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Volume volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 (b706ae4f-56cd-41fd-8f50-28970cf561d4): created successfully Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855b99c9-e386-413e-a793-4dd90b4af11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:58 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Flow 'volume_create_manager' (bfa19ebf-a41d-4132-a50a-da886ccbf529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-db0867b5-4d92-4f82-af1c-8f1192385aec tempest-SnapshotDependencyTests-1250890520 None] Created volume successfully. Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-4ce772da-831e-49ce-8e42-7640cd0ba1ad-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-4ce772da-831e-49ce-8e42-7640cd0ba1ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Deleting offline snapshot 4ce772da-831e-49ce-8e42-7640cd0ba1ad of volume 0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] snapshot_file for this snap is: volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb25575-6d6b-4d0d-a0f4-ef630d69ee20]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (b28a4418-95dd-4773-b96d-f39cc719e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c1bf1a-783d-45da-864c-968a86af756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c1bf1a-783d-45da-864c-968a86af756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241630954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabbc545-da1e-4f87-97a7-db20e5815c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:59Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6793de19-1578-4f33-81c2-2053a8c7ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6793de19-1578-4f33-81c2-2053a8c7ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:59 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:54:59 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa4363d-0825-45d2-b739-076577ad4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa4363d-0825-45d2-b739-076577ad4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabbc545-da1e-4f87-97a7-db20e5815c15', 'volume_name': 'volume-dabbc545-da1e-4f87-97a7-db20e5815c15', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4127d7a-7c84-499a-bb37-bc2b9b338cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4127d7a-7c84-499a-bb37-bc2b9b338cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd52446-d59c-466f-a396-7f16f0425139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:54:59 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Volume dabbc545-da1e-4f87-97a7-db20e5815c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabbc545-da1e-4f87-97a7-db20e5815c15', 'volume_size': 1} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241630954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabbc545-da1e-4f87-97a7-db20e5815c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:54:59Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Creating volume dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:54:59 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:59 devstack sudo[114187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 1073741824 Aug 20 06:54:59 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:59 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a3c65-0434-4d7c-bb61-2d644d646dac]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:59 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:54:59 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:54:59 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 1073741824" returned: 0 in 0.435s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:54:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:54:59 devstack sudo[114198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 Aug 20 06:54:59 devstack sudo[114198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:00 devstack sudo[114198]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15" returned: 0 in 0.252s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd52446-d59c-466f-a396-7f16f0425139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabbc545-da1e-4f87-97a7-db20e5815c15', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ceb94-0c4c-48a8-8949-ea1aa80a842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:00 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Volume volume-dabbc545-da1e-4f87-97a7-db20e5815c15 (dabbc545-da1e-4f87-97a7-db20e5815c15): created successfully Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ceb94-0c4c-48a8-8949-ea1aa80a842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (b28a4418-95dd-4773-b96d-f39cc719e26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:00 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-b002a699-1c2e-43b4-9b89-5bd960e43885 tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:55:00 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.613s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:00 devstack sudo[114207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:55:00 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Creating offline snapshot b68a2c02-0171-4957-b4d7-14c69f089f7b of volume dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c3fe03-9cb7-417b-af71-140a1e886364]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:00 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 Aug 20 06:55:00 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:00 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:00 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad Aug 20 06:55:00 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:00 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15" returned: 0 in 0.378s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:00 devstack sudo[114220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b 1G Aug 20 06:55:00 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:00 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e.4ce772da-831e-49ce-8e42-7640cd0ba1ad" returned: 0 in 0.265s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-4ce772da-831e-49ce-8e42-7640cd0ba1ad" released by "_delete_snapshot" :: held 1.817s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" released by "delete_snapshot" :: held 1.852s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Created reservations ['cb7375d1-cd9b-41e3-b23e-8930d4b1cadc', 'd13f4d2a-fce3-4ed0-adb3-6f70a651837e', 'f028e199-d751-4ef2-aff0-d3c7726e5d02', '7f9be51f-97ef-43a7-b203-9b4bc22ff2e0'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Delete snapshot completed successfully. Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e926a26b-01cc-4338-b643-2a8747dc1667 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-4ce772da-831e-49ce-8e42-7640cd0ba1ad-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-0fb405d2-7f00-46eb-ad6e-dfd81376b73e-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-0fb405d2-7f00-46eb-ad6e-dfd81376b73e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:01 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b 1G" returned: 0 in 0.444s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabbc545-da1e-4f87-97a7-db20e5815c15 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:01 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabbc545-da1e-4f87-97a7-db20e5815c15 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b Aug 20 06:55:01 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" acquired by "delete_volume" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e258806-5d60-4c2f-9757-1d43756319c4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:01 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:55:01 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:01 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabbc545-da1e-4f87-97a7-db20e5815c15 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b" returned: 0 in 0.311s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:01 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b is being set with open permissions: ugo+rw Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:01 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b Aug 20 06:55:01 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:01 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:01 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e Aug 20 06:55:01 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:01 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b" returned: 0 in 0.256s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:02 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info Aug 20 06:55:02 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:02 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-0fb405d2-7f00-46eb-ad6e-dfd81376b73e" released by "delete_volume" :: held 0.664s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Created reservations ['b13b2b11-8c1c-4da8-b891-e0e768d93d0b', '5d08933a-41ef-4e8f-85ea-5be5e26dd81c', '0e08c8ea-1576-40ed-a1f5-f4fe7999e87c', '0cfe39c3-cc8a-4703-87f9-f78f5a5afcb1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:02 devstack sudo[114254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:02 devstack sudo[114254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:02 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info" returned: 0 in 0.266s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:02 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info is being set with open permissions: ugo+rw Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:02 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info Aug 20 06:55:02 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:02 devstack sudo[114254]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.258s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Deleted volume successfully. Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8bfc0ad5-7497-4e22-a63b-a3c0baf028db tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-0fb405d2-7f00-46eb-ad6e-dfd81376b73e-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:02 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-b706ae4f-56cd-41fd-8f50-28970cf561d4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.info" returned: 0 in 0.266s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-b706ae4f-56cd-41fd-8f50-28970cf561d4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-088556cb-a33a-4492-8508-254eecfa0bad tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e645a-a4a2-4940-a197-b2b7213289b4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:02 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 Aug 20 06:55:02 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:02 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:03 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4 Aug 20 06:55:03 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:03 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-b706ae4f-56cd-41fd-8f50-28970cf561d4" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-quobyte-b706ae4f-56cd-41fd-8f50-28970cf561d4" released by "delete_volume" :: held 0.623s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Created reservations ['1ab21493-6f26-4aa6-91da-857a6a740555', '99f6295e-e1f3-4f36-89b4-239287eae607', 'e17dbd3b-f2af-4d2d-a263-a3bf6b864d1e', 'be701093-aa92-42e7-bda1-711437f8886b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:03 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:03 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:03 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.258s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:03 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Deleted volume successfully. Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-fd749fb9-ff91-4757-8786-8e473e94ddc0 tempest-SnapshotDependencyTests-1250890520 None] Lock "cinder-b706ae4f-56cd-41fd-8f50-28970cf561d4-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-b68a2c02-0171-4957-b4d7-14c69f089f7b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-b68a2c02-0171-4957-b4d7-14c69f089f7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-b68a2c02-0171-4957-b4d7-14c69f089f7b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-b68a2c02-0171-4957-b4d7-14c69f089f7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot b68a2c02-0171-4957-b4d7-14c69f089f7b of volume dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2e3a9-749c-4d60-893f-df793ec17993]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:03 devstack sudo[114271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b Aug 20 06:55:03 devstack sudo[114271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:04 devstack sudo[114271]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b" returned: 0 in 0.375s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabbc545-da1e-4f87-97a7-db20e5815c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b1f8e-3507-4fd1-a3a3-f0b5db803ce4]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:04 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 Aug 20 06:55:04 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:04 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15" returned: 0 in 0.379s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:04 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b Aug 20 06:55:04 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:04 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:04 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b Aug 20 06:55:04 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:05 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15.b68a2c02-0171-4957-b4d7-14c69f089f7b" returned: 0 in 0.276s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-b68a2c02-0171-4957-b4d7-14c69f089f7b" released by "_delete_snapshot" :: held 1.478s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" released by "delete_snapshot" :: held 1.504s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Created reservations ['05719d0b-e563-4a8d-9705-55272eb389c5', '0579c683-7d43-4c18-8da3-39efe4497256', '1c97bc15-449e-4d99-8540-1f940567fd79', '107de43f-82e0-4233-ba71-7552086feb92'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d42c7560-6bf1-48db-83cb-b122627f5602 tempest-ProjectMemberTests-375579751 None] Lock "cinder-b68a2c02-0171-4957-b4d7-14c69f089f7b-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-dabbc545-da1e-4f87-97a7-db20e5815c15-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "cinder-dabbc545-da1e-4f87-97a7-db20e5815c15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e439c-1fbc-4641-b41a-c5972e4f7e75]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:06 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 Aug 20 06:55:06 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:06 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15" returned: 0 in 0.420s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:06 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15 Aug 20 06:55:06 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:06 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-dabbc545-da1e-4f87-97a7-db20e5815c15" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-dabbc545-da1e-4f87-97a7-db20e5815c15" released by "delete_volume" :: held 0.719s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Created reservations ['903636aa-7b2e-4ddc-9c1a-dbd46a169a57', '78c1ba05-4302-4b82-860d-e4372b336600', '3acc22df-3c21-417b-b401-66597abdcc64', '96a04419-699f-4a16-ba07-dc48bfd99c32'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:06 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:06 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:07 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.252s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:07 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-95dfeaae-9c47-4e59-8bdd-b9b2295b49df tempest-ProjectMemberTests-375579751 None] Lock "cinder-dabbc545-da1e-4f87-97a7-db20e5815c15-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (27c0f41f-049a-47fa-ace0-2d1da136d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4677b24-efd8-40d6-8360-d11d6191c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4677b24-efd8-40d6-8360-d11d6191c7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910127622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8969a2-c087-495e-b43d-aec95bc38bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:08Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb4f687-c9d5-48a4-8454-c87f51f34545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb4f687-c9d5-48a4-8454-c87f51f34545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b65d76-431f-4773-bcfa-3253c1747cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b65d76-431f-4773-bcfa-3253c1747cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8969a2-c087-495e-b43d-aec95bc38bce', 'volume_name': 'volume-3a8969a2-c087-495e-b43d-aec95bc38bce', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad893469-d6c3-41ab-8465-ce7c72349077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad893469-d6c3-41ab-8465-ce7c72349077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82c2ff3-7162-4d31-8633-c1bb4f6cb513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:07 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Volume 3a8969a2-c087-495e-b43d-aec95bc38bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8969a2-c087-495e-b43d-aec95bc38bce', 'volume_size': 1} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910127622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8969a2-c087-495e-b43d-aec95bc38bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:08Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Creating volume 3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:07 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:07 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce 1073741824 Aug 20 06:55:07 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:08 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce 1073741824" returned: 0 in 0.488s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:08 devstack sudo[114311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce Aug 20 06:55:08 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:08 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82c2ff3-7162-4d31-8633-c1bb4f6cb513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8969a2-c087-495e-b43d-aec95bc38bce', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d6a0bf-ee9f-4d17-b6ac-d153f8505335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:08 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Volume volume-3a8969a2-c087-495e-b43d-aec95bc38bce (3a8969a2-c087-495e-b43d-aec95bc38bce): created successfully Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d6a0bf-ee9f-4d17-b6ac-d153f8505335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:08 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (27c0f41f-049a-47fa-ace0-2d1da136d63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-75aecdbd-293e-4764-862e-d53ce7843bb6 tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:55:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot c45d687a-15fd-43bf-9c8a-357280e10a86 of volume 3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:09 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[71979c8f-45e2-4e57-a984-73fae3f97f6f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:09 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce Aug 20 06:55:09 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:10 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce" returned: 0 in 0.374s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:10 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 1G Aug 20 06:55:10 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:10 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 1G" returned: 0 in 0.445s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8969a2-c087-495e-b43d-aec95bc38bce -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:10 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8969a2-c087-495e-b43d-aec95bc38bce -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 Aug 20 06:55:10 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:10 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8969a2-c087-495e-b43d-aec95bc38bce -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:10 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 is being set with open permissions: ugo+rw Aug 20 06:55:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:11 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 Aug 20 06:55:11 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:11 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:11 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info Aug 20 06:55:11 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:11 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info" returned: 0 in 0.314s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:11 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info is being set with open permissions: ugo+rw Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:11 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info Aug 20 06:55:11 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:11 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.info" returned: 0 in 0.261s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:11 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c846aacb-b5fb-4488-945a-e65ecfacb0c9 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-c45d687a-15fd-43bf-9c8a-357280e10a86-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-c45d687a-15fd-43bf-9c8a-357280e10a86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-c45d687a-15fd-43bf-9c8a-357280e10a86" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-c45d687a-15fd-43bf-9c8a-357280e10a86" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot c45d687a-15fd-43bf-9c8a-357280e10a86 of volume 3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31df90d-d579-4069-978c-14844e852e54]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:13 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 Aug 20 06:55:13 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:13 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86" returned: 0 in 0.402s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8969a2-c087-495e-b43d-aec95bc38bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b8f24-6595-4ab4-ac55-a4a462c2bb6d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:13 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce Aug 20 06:55:13 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:13 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce" returned: 0 in 0.387s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:13 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 Aug 20 06:55:13 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:14 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86" returned: 0 in 0.367s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:14 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86 Aug 20 06:55:14 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:14 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce.c45d687a-15fd-43bf-9c8a-357280e10a86" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-c45d687a-15fd-43bf-9c8a-357280e10a86" released by "_delete_snapshot" :: held 1.505s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" released by "delete_snapshot" :: held 1.534s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Created reservations ['1a645748-ea59-4439-b972-f35f5cb26d19', 'ac4daac9-d07e-43ab-ba54-6859f1fea3ed', 'bc27f178-0ed5-459c-a0a0-a556f8c56c5c', '5b1332b5-6f9a-4ee9-9927-ae4835ee3527'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:14 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:55:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a8e16e81-3f9c-44f9-977e-65aff69433ed tempest-ProjectMemberTests-375579751 None] Lock "cinder-c45d687a-15fd-43bf-9c8a-357280e10a86-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-3a8969a2-c087-495e-b43d-aec95bc38bce-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "cinder-3a8969a2-c087-495e-b43d-aec95bc38bce-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f6f2f-361c-41b6-acba-9f35d219a9a6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:15 devstack sudo[114359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce Aug 20 06:55:15 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:15 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:15 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce Aug 20 06:55:15 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:15 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-3a8969a2-c087-495e-b43d-aec95bc38bce" returned: 0 in 0.252s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3a8969a2-c087-495e-b43d-aec95bc38bce" released by "delete_volume" :: held 0.663s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:15 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Created reservations ['4a9eacfa-b28c-4f51-8b86-97c4b7e437f3', '130af8a6-514c-43a3-b71f-54d55b8b0de7', '43c60e1a-c4d0-428d-aaf8-921617632abf', '75f6ae5c-568f-4984-8e14-184b5329858c'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:16 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:16 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:16 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.266s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:16 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-e51c3176-4e6b-42e5-9682-aa0aa3591d3b tempest-ProjectMemberTests-375579751 None] Lock "cinder-3a8969a2-c087-495e-b43d-aec95bc38bce-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (c8209f1b-2045-43da-adb2-3c5f5a90ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a43468b-cab1-4270-ade2-195c4928d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a43468b-cab1-4270-ade2-195c4928d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324556064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deff76a6-b0d4-48f3-8200-42056a22466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:17Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ec23bc-a38a-4649-9a50-44236f9d5c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ec23bc-a38a-4649-9a50-44236f9d5c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e761a88-9042-414f-bad5-a32dde2c86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e761a88-9042-414f-bad5-a32dde2c86ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deff76a6-b0d4-48f3-8200-42056a22466b', 'volume_name': 'volume-deff76a6-b0d4-48f3-8200-42056a22466b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c2662c-91f3-46b7-9966-33483f0eff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c2662c-91f3-46b7-9966-33483f0eff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7715bd34-a26a-454d-8ebb-1f8f245840e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:16 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Volume deff76a6-b0d4-48f3-8200-42056a22466b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deff76a6-b0d4-48f3-8200-42056a22466b', 'volume_size': 1} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324556064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deff76a6-b0d4-48f3-8200-42056a22466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:17Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Creating volume deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:16 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:16 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:16 devstack sudo[114785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b 1073741824 Aug 20 06:55:16 devstack sudo[114785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:17 devstack sudo[114785]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b 1073741824" returned: 0 in 0.414s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:17 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b Aug 20 06:55:17 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:17 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7715bd34-a26a-454d-8ebb-1f8f245840e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deff76a6-b0d4-48f3-8200-42056a22466b', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c34bc0-f5fc-43ff-9581-7b7e1914c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:17 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Volume volume-deff76a6-b0d4-48f3-8200-42056a22466b (deff76a6-b0d4-48f3-8200-42056a22466b): created successfully Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c34bc0-f5fc-43ff-9581-7b7e1914c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (c8209f1b-2045-43da-adb2-3c5f5a90ca68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:17 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0a716e77-ecb5-454d-8101-46bb895a9ecc tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot 3e88001a-b62e-4292-88ee-b248723e4a0b of volume deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddff93c5-c223-4265-a9f4-d86277845723]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:17 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:18 devstack sudo[114793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b Aug 20 06:55:18 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:18 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b" returned: 0 in 0.356s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:18 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b 1G Aug 20 06:55:18 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:18 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b 1G" returned: 0 in 0.384s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deff76a6-b0d4-48f3-8200-42056a22466b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:18 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deff76a6-b0d4-48f3-8200-42056a22466b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b Aug 20 06:55:18 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:18 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deff76a6-b0d4-48f3-8200-42056a22466b -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b" returned: 0 in 0.282s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:18 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b is being set with open permissions: ugo+rw Aug 20 06:55:18 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:18 devstack sudo[114809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b Aug 20 06:55:18 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:19 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b" returned: 0 in 0.231s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=131,cinder:UPDATE=167,cinder:INSERT=52,cinder:DELETE=20 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:UPDATE=196,cinder:SELECT=148,cinder:INSERT=43,cinder:DELETE=11 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:19 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info Aug 20 06:55:19 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:19 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info" returned: 0 in 0.245s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:19 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info is being set with open permissions: ugo+rw Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:19 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info Aug 20 06:55:19 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:19 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.info" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:19 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:19 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-71ee85cb-d5cd-402e-aec6-954fd73c2ae8 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-3e88001a-b62e-4292-88ee-b248723e4a0b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-3e88001a-b62e-4292-88ee-b248723e4a0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-3e88001a-b62e-4292-88ee-b248723e4a0b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3e88001a-b62e-4292-88ee-b248723e4a0b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot 3e88001a-b62e-4292-88ee-b248723e4a0b of volume deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3615c9e-5e3a-47d6-81b9-4bde779a1856]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:20 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b Aug 20 06:55:20 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:20 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deff76a6-b0d4-48f3-8200-42056a22466b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04cc10-6c41-43d3-a3b0-8f72e8a96290]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:20 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b Aug 20 06:55:20 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:20 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:20 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:20 devstack sudo[114828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b Aug 20 06:55:20 devstack sudo[114828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:21 devstack sudo[114828]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b" returned: 0 in 0.331s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:21 devstack sudo[114833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b Aug 20 06:55:21 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:21 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b.3e88001a-b62e-4292-88ee-b248723e4a0b" returned: 0 in 0.240s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-3e88001a-b62e-4292-88ee-b248723e4a0b" released by "_delete_snapshot" :: held 1.354s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" released by "delete_snapshot" :: held 1.375s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Created reservations ['4df36146-8040-44bc-8327-485a4b78d887', '9252dacd-f327-491e-af5f-95a7b478855a', '7844d2a2-ff1b-4db6-b9f2-1883aa8fce8f', '92e1cdef-b9af-4b08-a9f6-982b6bdf02d9'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:21 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:55:21 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-cb54a3b9-66dd-4ed9-a8ba-637101179b2b tempest-ProjectMemberTests-375579751 None] Lock "cinder-3e88001a-b62e-4292-88ee-b248723e4a0b-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-deff76a6-b0d4-48f3-8200-42056a22466b-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "cinder-deff76a6-b0d4-48f3-8200-42056a22466b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78b21fb-08fb-4fff-8ab8-30fd63edbed8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:22 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b Aug 20 06:55:22 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:22 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b" returned: 0 in 0.359s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:22 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b Aug 20 06:55:22 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:22 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-deff76a6-b0d4-48f3-8200-42056a22466b" returned: 0 in 0.233s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-deff76a6-b0d4-48f3-8200-42056a22466b" released by "delete_volume" :: held 0.646s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Created reservations ['0bb63cca-3b15-400f-a8f1-ac21cb186d9b', '08021e13-3c09-476c-bfee-00ad11880e6b', '2d87de95-425d-40d6-b500-e43b4b0e9ac4', '0131c9c7-d95d-4243-9c33-47fe84cf01c2'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:22 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:23 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:23 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:23 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.240s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:23 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-33f568aa-1282-4c40-8d6b-eb53b2d28a35 tempest-ProjectMemberTests-375579751 None] Lock "cinder-deff76a6-b0d4-48f3-8200-42056a22466b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (0b6a00ac-0639-431c-a91e-e3925569ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d576dcaa-61f7-44f4-b36a-147db887c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d576dcaa-61f7-44f4-b36a-147db887c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235303729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd86624-ee24-4640-9ad9-69bee172d741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:24Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af18a6-ff60-4a62-bc01-bc2214b44a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af18a6-ff60-4a62-bc01-bc2214b44a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c0be0-946e-4639-8fe6-e9c51f1bf0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c0be0-946e-4639-8fe6-e9c51f1bf0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd86624-ee24-4640-9ad9-69bee172d741', 'volume_name': 'volume-bfd86624-ee24-4640-9ad9-69bee172d741', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f89982-0d3c-4586-8298-0923f74f0ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f89982-0d3c-4586-8298-0923f74f0ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aedddae-2143-4e71-b2da-b00ea202c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:23 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Volume bfd86624-ee24-4640-9ad9-69bee172d741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd86624-ee24-4640-9ad9-69bee172d741', 'volume_size': 1} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235303729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd86624-ee24-4640-9ad9-69bee172d741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:24Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Creating volume bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:23 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:23 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:23 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 1073741824 Aug 20 06:55:23 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:24 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 1073741824" returned: 0 in 0.406s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:24 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 Aug 20 06:55:24 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:24 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aedddae-2143-4e71-b2da-b00ea202c913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd86624-ee24-4640-9ad9-69bee172d741', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db342f0-f1b3-45ea-9c26-ae94e07687f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:24 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Volume volume-bfd86624-ee24-4640-9ad9-69bee172d741 (bfd86624-ee24-4640-9ad9-69bee172d741): created successfully Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db342f0-f1b3-45ea-9c26-ae94e07687f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (0b6a00ac-0639-431c-a91e-e3925569ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:24 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-16016565-7b85-4cd4-85dd-e7cd94513d10 tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Creating offline snapshot 9d94c104-69c8-4ba5-96d8-cdba3bf0866b of volume bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94fbb76-ce66-45f7-89e3-e244611af838]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:24 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:25 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 Aug 20 06:55:25 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:25 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741" returned: 0 in 0.357s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:25 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b 1G Aug 20 06:55:25 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:25 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b 1G" returned: 0 in 0.401s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd86624-ee24-4640-9ad9-69bee172d741 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:25 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd86624-ee24-4640-9ad9-69bee172d741 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b Aug 20 06:55:25 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:25 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:25 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd86624-ee24-4640-9ad9-69bee172d741 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b" returned: 0 in 0.293s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:26 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b is being set with open permissions: ugo+rw Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:26 devstack sudo[114871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b Aug 20 06:55:26 devstack sudo[114871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:26 devstack sudo[114871]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b" returned: 0 in 0.245s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:26 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info Aug 20 06:55:26 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:26 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:26 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info is being set with open permissions: ugo+rw Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:26 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info Aug 20 06:55:26 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:26 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.info" returned: 0 in 0.235s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:26 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:26 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9bd9c564-7572-46e5-b132-3b8807eb1963 tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-9d94c104-69c8-4ba5-96d8-cdba3bf0866b-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-9d94c104-69c8-4ba5-96d8-cdba3bf0866b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-9d94c104-69c8-4ba5-96d8-cdba3bf0866b" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-9d94c104-69c8-4ba5-96d8-cdba3bf0866b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot 9d94c104-69c8-4ba5-96d8-cdba3bf0866b of volume bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a826aef-bc17-45a5-8a61-3546ec72e30b]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:27 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b Aug 20 06:55:27 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:27 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b" returned: 0 in 0.357s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd86624-ee24-4640-9ad9-69bee172d741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e3fa4-5c32-491b-8afd-74921209a0e8]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:27 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 Aug 20 06:55:27 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:27 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:27 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:27 devstack sudo[114890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b Aug 20 06:55:27 devstack sudo[114890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:28 devstack sudo[114890]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b" returned: 0 in 0.331s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:28 devstack sudo[114896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b Aug 20 06:55:28 devstack sudo[114896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:28 devstack sudo[114896]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741.9d94c104-69c8-4ba5-96d8-cdba3bf0866b" returned: 0 in 0.245s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-9d94c104-69c8-4ba5-96d8-cdba3bf0866b" released by "_delete_snapshot" :: held 1.363s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" released by "delete_snapshot" :: held 1.384s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Created reservations ['525419e7-9fd6-4170-8f9d-bf484448bd7c', '6c772413-bf93-49c1-a7aa-e0fec1eb352a', '21d3b428-c499-4ce9-bae1-f215aa452694', '13e6c9c7-7c56-46fd-a1ba-d2e4e45c577b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:28 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:55:28 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cb4db33-63ef-47e4-b1a5-53cec5927e0e tempest-ProjectMemberTests-375579751 None] Lock "cinder-9d94c104-69c8-4ba5-96d8-cdba3bf0866b-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-bfd86624-ee24-4640-9ad9-69bee172d741-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "cinder-bfd86624-ee24-4640-9ad9-69bee172d741-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" acquired by "delete_volume" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a3807f-1d69-4245-90fe-cdcb94c5158c]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:29 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 Aug 20 06:55:29 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:29 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:29 devstack sudo[114904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741 Aug 20 06:55:29 devstack sudo[114904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:29 devstack sudo[114904]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-bfd86624-ee24-4640-9ad9-69bee172d741" returned: 0 in 0.236s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-bfd86624-ee24-4640-9ad9-69bee172d741" released by "delete_volume" :: held 0.631s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Created reservations ['b9fbb687-feea-467f-ad10-922101172855', '04c9127e-3474-4f27-a376-6621223f8092', '98979de8-91b4-4646-a695-9a74ec84243b', '7f120162-62f6-4833-b2a9-82cc12ac582a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:29 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:30 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:30 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:30 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:30 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51afe8eb-b5e8-431e-a5e6-23148ec590fe tempest-ProjectMemberTests-375579751 None] Lock "cinder-bfd86624-ee24-4640-9ad9-69bee172d741-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (7b0ff4a6-3612-41d0-a9ef-32dbc1585316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf21c3f-4703-4eb8-9847-3849db86d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf21c3f-4703-4eb8-9847-3849db86d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221401842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:31Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad00fe6a-922e-4a90-a277-06915d44e34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad00fe6a-922e-4a90-a277-06915d44e34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681756d3-5ee3-4d88-ba4f-117af6d02c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681756d3-5ee3-4d88-ba4f-117af6d02c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d', 'volume_name': 'volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dbde62-c2f1-4ae9-88ab-1aff624d19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dbde62-c2f1-4ae9-88ab-1aff624d19e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a8f41b-98c6-4063-9f69-5000f2e764a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:30 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Volume cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d', 'volume_size': 1} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221401842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f068fc0ef04f519bbf69b5b659376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:31Z,use_quota=True,user_id='6b8f11196130498aaa9863e125073e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Creating volume cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:30 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:30 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:30 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d 1073741824 Aug 20 06:55:30 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:31 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d 1073741824" returned: 0 in 0.404s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:31 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d Aug 20 06:55:31 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:31 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" returned: 0 in 0.245s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a8f41b-98c6-4063-9f69-5000f2e764a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c78df7-e633-48a2-8734-980f756921e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:31 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Volume volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d (cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d): created successfully Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c78df7-e633-48a2-8734-980f756921e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Flow 'volume_create_manager' (7b0ff4a6-3612-41d0-a9ef-32dbc1585316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:31 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5a2fbe6e-10d4-43c9-a308-62f54d93e18d tempest-ProjectMemberTests-375579751 None] Created volume successfully. Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Creating offline snapshot c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb of volume cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02be8ad-0d4a-4bcb-bb68-2afa33f6c154]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:31 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:32 devstack sudo[114919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d Aug 20 06:55:32 devstack sudo[114919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:32 devstack sudo[114919]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" returned: 0 in 0.362s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:32 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb 1G Aug 20 06:55:32 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:32 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb 1G" returned: 0 in 0.391s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:32 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:32 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb Aug 20 06:55:32 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:33 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:33 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb is being set with open permissions: ugo+rw Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:33 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb Aug 20 06:55:33 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:33 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" returned: 0 in 0.235s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:33 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info Aug 20 06:55:33 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:33 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info" returned: 0 in 0.240s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:33 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info is being set with open permissions: ugo+rw Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:33 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info Aug 20 06:55:33 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:33 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.info" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:33 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:33 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9b5a8d06-277c-428c-a7cb-6b16ea35a23d tempest-ProjectMemberTests-375579751 None] Create snapshot completed successfully Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Deleting offline snapshot c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb of volume cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] snapshot_file for this snap is: volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[21073685-f943-42f1-9ecd-ad412ba6801d]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:34 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb Aug 20 06:55:34 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:34 devstack sudo[114946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:34 devstack sudo[114946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:34 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" returned: 0 in 0.361s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540460e-1622-447e-8b06-a3b673373d71]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:34 devstack sudo[114946]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.249s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 20 06:55:34 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d Aug 20 06:55:34 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:34 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" returned: 0 in 0.345s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:34 devstack sudo[114957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb Aug 20 06:55:34 devstack sudo[114957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:35 devstack sudo[114957]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" returned: 0 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:35 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb Aug 20 06:55:35 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:35 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d.c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb" released by "_delete_snapshot" :: held 1.366s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" released by "delete_snapshot" :: held 1.385s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Created reservations ['30277a18-1715-406c-8768-87ada4694c20', '122dec16-5812-4052-8884-04974bafe839', 'af38d202-7611-4124-8054-8c6e88d46aac', 'e18059a6-63c5-4701-8d26-68d472bdcb03'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:35 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Delete snapshot completed successfully. Aug 20 06:55:35 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7aef0014-134a-4db3-a661-0d2a8c950645 tempest-ProjectMemberTests-375579751 None] Lock "cinder-c2d616bb-4ebb-44ad-873b-e0ea2e15e8bb-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "cinder-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Acquiring lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" acquired by "delete_volume" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc9c69-4b99-40a8-a4ab-af8fb79880b7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:36 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d Aug 20 06:55:36 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:36 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" returned: 0 in 0.343s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:36 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d Aug 20 06:55:36 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:36 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" returned: 0 in 0.234s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:36 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "cinder-quobyte-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d" released by "delete_volume" :: held 0.628s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Created reservations ['72fcd403-6ce7-454b-b5e6-1f16c3a9d873', '1561b3ff-cdab-424e-a345-a9f82e615af1', 'f66389cd-4cdc-4c12-a19f-65bdf7615a89', '0d7b5f68-4102-420a-8def-f1b6dc3f9bf6'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:37 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:37 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:37 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.235s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:37 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Deleted volume successfully. Aug 20 06:55:37 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a7ba8f23-e0ab-4dc3-829a-454a6b2211f4 tempest-ProjectMemberTests-375579751 None] Lock "cinder-cb75759c-8f0b-4aaf-9eef-f8c0ce1c2d4d-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (f08d4d46-3357-4dd5-befa-f9de5a5f5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e35722-25e1-4b8d-8446-127601095a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e35722-25e1-4b8d-8446-127601095a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182575167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7591b5b7-ffda-4801-a939-6f2f455bcac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:41Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d41f980-1f58-4696-aaae-aa1653071024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d41f980-1f58-4696-aaae-aa1653071024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccc4cd5-4d95-4d0f-bb22-0d4486c7f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccc4cd5-4d95-4d0f-bb22-0d4486c7f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7591b5b7-ffda-4801-a939-6f2f455bcac4', 'volume_name': 'volume-7591b5b7-ffda-4801-a939-6f2f455bcac4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4bc4ae-a63b-4230-bf08-9326154f2c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4bc4ae-a63b-4230-bf08-9326154f2c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d084fb00-161b-4a42-9457-a954d6ede824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:40 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Volume 7591b5b7-ffda-4801-a939-6f2f455bcac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7591b5b7-ffda-4801-a939-6f2f455bcac4', 'volume_size': 1} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182575167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7591b5b7-ffda-4801-a939-6f2f455bcac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:41Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Creating volume 7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:40 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:40 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:40 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 1073741824 Aug 20 06:55:40 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:41 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 1073741824" returned: 0 in 0.405s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:41 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 Aug 20 06:55:41 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:41 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4" returned: 0 in 0.236s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d084fb00-161b-4a42-9457-a954d6ede824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7591b5b7-ffda-4801-a939-6f2f455bcac4', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec00026-59da-4e31-a3bc-5f8156615e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:41 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Volume volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 (7591b5b7-ffda-4801-a939-6f2f455bcac4): created successfully Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec00026-59da-4e31-a3bc-5f8156615e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:41 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (f08d4d46-3357-4dd5-befa-f9de5a5f5245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:41 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-76e0634b-9951-495c-9c2d-45c553d57b8b tempest-ProjectReaderTests-727202221 None] Created volume successfully. Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Creating offline snapshot 184e0271-97c0-4e0b-a940-0a47bf8bf1f8 of volume 7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa38d1-2351-489d-b6a1-7a18b25ecbcb]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:42 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 Aug 20 06:55:42 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:42 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4" returned: 0 in 0.366s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:42 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 1G Aug 20 06:55:42 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:42 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 1G" returned: 0 in 0.375s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:42 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:42 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 Aug 20 06:55:42 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:43 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8" returned: 0 in 0.287s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:43 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 is being set with open permissions: ugo+rw Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:43 devstack sudo[115003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 Aug 20 06:55:43 devstack sudo[115003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:43 devstack sudo[115003]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8" returned: 0 in 0.259s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:43 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info Aug 20 06:55:43 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:43 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:43 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info is being set with open permissions: ugo+rw Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:43 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info Aug 20 06:55:43 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:43 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.info" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:43 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:43 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-0d06dfaa-5f63-4c09-8466-e0303527b66d tempest-ProjectReaderTests-727202221 None] Create snapshot completed successfully Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-184e0271-97c0-4e0b-a940-0a47bf8bf1f8-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-184e0271-97c0-4e0b-a940-0a47bf8bf1f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-184e0271-97c0-4e0b-a940-0a47bf8bf1f8" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-184e0271-97c0-4e0b-a940-0a47bf8bf1f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Deleting offline snapshot 184e0271-97c0-4e0b-a940-0a47bf8bf1f8 of volume 7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] snapshot_file for this snap is: volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[65314657-30ea-494d-b960-e3b5e1f10cc2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:44 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 Aug 20 06:55:44 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:44 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8" returned: 0 in 0.360s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7591b5b7-ffda-4801-a939-6f2f455bcac4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a3111b-ebb7-4915-8eb3-c0be7a0fdc0f]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:44 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:44 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 Aug 20 06:55:44 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:45 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4" returned: 0 in 0.354s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:45 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 Aug 20 06:55:45 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:45 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8" returned: 0 in 0.338s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:45 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8 Aug 20 06:55:45 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:45 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4.184e0271-97c0-4e0b-a940-0a47bf8bf1f8" returned: 0 in 0.234s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-184e0271-97c0-4e0b-a940-0a47bf8bf1f8" released by "_delete_snapshot" :: held 1.378s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" released by "delete_snapshot" :: held 1.401s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Created reservations ['6ea4a51b-8c4b-48ef-94fe-6776f7af29ad', '1002219f-1551-4daa-9102-cb0590843991', '5e793b4c-3331-4405-b8ab-1d1cd30f350d', 'cf7a762d-c8fc-474d-8f35-0b23d908825d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:45 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Delete snapshot completed successfully. Aug 20 06:55:45 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-8ad924bd-980a-4854-9ca1-5cbe2b4d13d8 tempest-ProjectReaderTests-727202221 None] Lock "cinder-184e0271-97c0-4e0b-a940-0a47bf8bf1f8-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-7591b5b7-ffda-4801-a939-6f2f455bcac4-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "cinder-7591b5b7-ffda-4801-a939-6f2f455bcac4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" acquired by "delete_volume" :: waited 0.019s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc3d57a-8893-4a89-8d23-c52600cf62fa]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:46 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 Aug 20 06:55:46 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:46 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4" returned: 0 in 0.339s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:46 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:46 devstack sudo[115037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4 Aug 20 06:55:46 devstack sudo[115037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:47 devstack sudo[115037]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-7591b5b7-ffda-4801-a939-6f2f455bcac4" returned: 0 in 0.250s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-7591b5b7-ffda-4801-a939-6f2f455bcac4" released by "delete_volume" :: held 0.645s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Created reservations ['f269e666-1ded-41b4-a395-5d8309700aa8', 'c51c18f8-725a-49c1-bfaa-863b3f9a5281', 'e544d769-3061-48f0-bcf5-5b1f0b6e8ca0', 'bd77bcb5-1f07-4e3c-8e08-d08956db591a'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:47 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:47 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:47 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:47 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Deleted volume successfully. Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-ce11fcd3-055e-4d02-ba9d-e007bfc11a6b tempest-ProjectReaderTests-727202221 None] Lock "cinder-7591b5b7-ffda-4801-a939-6f2f455bcac4-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:47 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (2aa50fc8-5b0c-4b48-acc1-46945831940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905c566e-caea-425e-817c-c4c03af394d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905c566e-caea-425e-817c-c4c03af394d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486985092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0977046-4450-4e0a-9e0b-3fb39d6995f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:48Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1d2fb2-0f9c-4658-8ba3-7ac2770c21e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1d2fb2-0f9c-4658-8ba3-7ac2770c21e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842da0eb-ccf9-4721-b72b-d2a0b760989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842da0eb-ccf9-4721-b72b-d2a0b760989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0977046-4450-4e0a-9e0b-3fb39d6995f0', 'volume_name': 'volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764df84-1877-43c8-82e4-d83ef43f29e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764df84-1877-43c8-82e4-d83ef43f29e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de8b32b-ce8e-4416-bbdf-c2f27fe9ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Volume e0977046-4450-4e0a-9e0b-3fb39d6995f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0', 'volume_size': 1} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486985092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0977046-4450-4e0a-9e0b-3fb39d6995f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:48Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Creating volume e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:48 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:48 devstack sudo[115044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 1073741824 Aug 20 06:55:48 devstack sudo[115044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:48 devstack sudo[115044]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 1073741824" returned: 0 in 0.404s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:48 devstack sudo[115049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 Aug 20 06:55:48 devstack sudo[115049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:48 devstack sudo[115049]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0" returned: 0 in 0.238s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de8b32b-ce8e-4416-bbdf-c2f27fe9ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dab29d-8091-47fe-a863-c44341cbbb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:48 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Volume volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 (e0977046-4450-4e0a-9e0b-3fb39d6995f0): created successfully Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dab29d-8091-47fe-a863-c44341cbbb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:48 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (2aa50fc8-5b0c-4b48-acc1-46945831940e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:48 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-851dae64-c480-4cb6-a22a-764e74c8184b tempest-ProjectReaderTests-727202221 None] Created volume successfully. Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Creating offline snapshot 91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f of volume e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fdff8-f6db-42dc-9502-fc5e6e602864]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:49 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 Aug 20 06:55:49 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:49 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0" returned: 0 in 0.351s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:49 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f 1G Aug 20 06:55:49 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:49 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f 1G" returned: 0 in 0.380s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:49 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:49 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f Aug 20 06:55:49 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:50 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" returned: 0 in 0.283s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:50 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f is being set with open permissions: ugo+rw Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:50 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f Aug 20 06:55:50 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:50 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" returned: 0 in 0.259s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:50 devstack sudo[115070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info Aug 20 06:55:50 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:50 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:50 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info is being set with open permissions: ugo+rw Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:50 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info Aug 20 06:55:50 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:50 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.info" returned: 0 in 0.233s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:50 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:50 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-c047d126-08a7-4a3a-8edd-ed38b024a65f tempest-ProjectReaderTests-727202221 None] Create snapshot completed successfully Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Deleting offline snapshot 91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f of volume e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] snapshot_file for this snap is: volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed8111-9c65-4277-8c1c-cd3ae2a89743]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:51 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f Aug 20 06:55:51 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:51 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" returned: 0 in 0.344s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc9e92-08a3-4b02-92f8-501da7f40dbe]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:51 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:51 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 Aug 20 06:55:51 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:52 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:52 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f Aug 20 06:55:52 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:52 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" returned: 0 in 0.326s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:52 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f Aug 20 06:55:52 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:52 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0.91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" returned: 0 in 0.246s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f" released by "_delete_snapshot" :: held 1.343s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" released by "delete_snapshot" :: held 1.364s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Created reservations ['32059009-0ba2-48e5-b321-be14faf18fbe', 'b6b1385b-bffc-495a-9237-150ab9e247e3', 'c94b030a-5708-4ddf-b6eb-054cbb9f732d', '66ae3a22-34f7-47cf-94db-ae98548321ff'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:52 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Delete snapshot completed successfully. Aug 20 06:55:52 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-27c2d5e3-a67f-4baf-8a9d-f482aa738919 tempest-ProjectReaderTests-727202221 None] Lock "cinder-91c1f1ce-d5d5-49c9-a0e5-f69b63cf9f5f-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-e0977046-4450-4e0a-9e0b-3fb39d6995f0-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "cinder-e0977046-4450-4e0a-9e0b-3fb39d6995f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" acquired by "delete_volume" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d87fd9d-ccae-4ec5-a3b0-cff3629c67f7]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:53 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 Aug 20 06:55:53 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:53 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:53 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:53 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0 Aug 20 06:55:53 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:54 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-e0977046-4450-4e0a-9e0b-3fb39d6995f0" returned: 0 in 0.246s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-e0977046-4450-4e0a-9e0b-3fb39d6995f0" released by "delete_volume" :: held 0.650s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Created reservations ['e6ec7ff9-1904-4928-ae9f-1751025e53d0', 'aa318a5e-46ab-4789-8ac1-120c2421bb0c', '253c134a-efa5-4150-8130-1e2a000ecf64', '3261ba0a-aca0-4fad-9c3a-38316aff3eef'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:54 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:55:54 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:54 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.240s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:55:54 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Deleted volume successfully. Aug 20 06:55:54 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-5cff3184-26ec-414e-a3e5-d65a13cd14b3 tempest-ProjectReaderTests-727202221 None] Lock "cinder-e0977046-4450-4e0a-9e0b-3fb39d6995f0-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (1e6454ac-5349-4d37-8996-661baa709cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e4a3f7-2769-4f68-9b35-f0959e70bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e4a3f7-2769-4f68-9b35-f0959e70bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263332140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1217777b-a0d0-4fa4-b966-50cdd1b59914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:55Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32922fa5-3dc7-4469-9415-fee2d80df8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32922fa5-3dc7-4469-9415-fee2d80df8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080df79-c296-42f9-bc96-6b19dbf5a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080df79-c296-42f9-bc96-6b19dbf5a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1217777b-a0d0-4fa4-b966-50cdd1b59914', 'volume_name': 'volume-1217777b-a0d0-4fa4-b966-50cdd1b59914', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b979e8b-5933-4699-9c2f-cabdb25b6187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b979e8b-5933-4699-9c2f-cabdb25b6187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b90219-1995-4a2b-b529-c363d734a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Volume 1217777b-a0d0-4fa4-b966-50cdd1b59914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1217777b-a0d0-4fa4-b966-50cdd1b59914', 'volume_size': 1} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263332140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1217777b-a0d0-4fa4-b966-50cdd1b59914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:55:55Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Creating volume 1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:55:55 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:55 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 1073741824 Aug 20 06:55:55 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:55 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 1073741824" returned: 0 in 0.412s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:55 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 Aug 20 06:55:55 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:55 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914" returned: 0 in 0.253s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b90219-1995-4a2b-b529-c363d734a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1217777b-a0d0-4fa4-b966-50cdd1b59914', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4130-519b-43dc-9eb6-f21c56e749b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:55:55 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Volume volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 (1217777b-a0d0-4fa4-b966-50cdd1b59914): created successfully Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4130-519b-43dc-9eb6-f21c56e749b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:55:55 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (1e6454ac-5349-4d37-8996-661baa709cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:55:55 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3e47201d-b2bd-48c6-a380-76d3be8b868a tempest-ProjectReaderTests-727202221 None] Created volume successfully. Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Creating offline snapshot 5dc6ad3f-7496-4600-a395-42bc4994c70c of volume 1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[87318092-14c3-4241-9358-a368e71a9382]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:56 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 Aug 20 06:55:56 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:56 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:56 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c 1G Aug 20 06:55:56 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:56 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c 1G" returned: 0 in 0.377s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:56 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:56 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c Aug 20 06:55:56 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:57 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c" returned: 0 in 0.284s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:57 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c is being set with open permissions: ugo+rw Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:57 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c Aug 20 06:55:57 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:57 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:57 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info Aug 20 06:55:57 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:57 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:57 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info is being set with open permissions: ugo+rw Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:57 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info Aug 20 06:55:57 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:57 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.info" returned: 0 in 0.233s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:57 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:55:58 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-99b8a9a2-1c51-4eb6-bc5d-bf83e02eab9a tempest-ProjectReaderTests-727202221 None] Create snapshot completed successfully Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-5dc6ad3f-7496-4600-a395-42bc4994c70c-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-5dc6ad3f-7496-4600-a395-42bc4994c70c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-5dc6ad3f-7496-4600-a395-42bc4994c70c" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-5dc6ad3f-7496-4600-a395-42bc4994c70c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Deleting offline snapshot 5dc6ad3f-7496-4600-a395-42bc4994c70c of volume 1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] snapshot_file for this snap is: volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998509b-2358-4f12-86f6-ae0d9af94e54]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:58 devstack sudo[115140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c Aug 20 06:55:58 devstack sudo[115140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:58 devstack sudo[115140]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c" returned: 0 in 0.368s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1217777b-a0d0-4fa4-b966-50cdd1b59914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93d94c-6af8-4e03-b641-fb4149483727]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:55:58 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:58 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 Aug 20 06:55:58 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:59 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914" returned: 0 in 0.352s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:59 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c Aug 20 06:55:59 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:59 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c" returned: 0 in 0.325s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:55:59 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c Aug 20 06:55:59 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:55:59 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914.5dc6ad3f-7496-4600-a395-42bc4994c70c" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-5dc6ad3f-7496-4600-a395-42bc4994c70c" released by "_delete_snapshot" :: held 1.376s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" released by "delete_snapshot" :: held 1.398s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Created reservations ['6b50fad3-9237-4be4-9b95-2d05c3c754bb', '0eec246c-ab2d-4564-abfb-5c3251c1eae8', '562e1fa7-c44e-4e07-bfff-9e90af112f92', '4d20534e-7615-4762-87e6-e662d8d37b7d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:55:59 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Delete snapshot completed successfully. Aug 20 06:55:59 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-26153a07-801a-480a-b7df-2dc98873106f tempest-ProjectReaderTests-727202221 None] Lock "cinder-5dc6ad3f-7496-4600-a395-42bc4994c70c-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-1217777b-a0d0-4fa4-b966-50cdd1b59914-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "cinder-1217777b-a0d0-4fa4-b966-50cdd1b59914-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" acquired by "delete_volume" :: waited 0.012s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56bc84-8c10-47db-bded-eee0fc79dac6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:00 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 Aug 20 06:56:00 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:00 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914" returned: 0 in 0.341s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:00 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:00 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914 Aug 20 06:56:00 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:01 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-1217777b-a0d0-4fa4-b966-50cdd1b59914" returned: 0 in 0.242s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-1217777b-a0d0-4fa4-b966-50cdd1b59914" released by "delete_volume" :: held 0.641s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Created reservations ['ef039f0b-7cc0-4f99-af66-a2864f29a760', '45162e04-9f79-4dc1-8bd2-689b8b50885c', '8f756f81-e3cf-4ca0-b248-c65120603a98', '876f41a9-6992-4ecd-81eb-53567a9a63e1'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:01 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:56:01 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:01 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:56:01 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Deleted volume successfully. Aug 20 06:56:01 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-7eaa8ad5-07d6-462f-8e3c-f1232bff82b7 tempest-ProjectReaderTests-727202221 None] Lock "cinder-1217777b-a0d0-4fa4-b966-50cdd1b59914-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (cf4a45f8-76ff-42b9-a340-6a15d0893c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd8d3b-92a3-4495-90d1-97e545d0350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd8d3b-92a3-4495-90d1-97e545d0350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557046206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0818d8-373c-438e-b664-fcba6212a86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:56:02Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768cbd0d-03f4-4481-b710-bd76c6f8586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768cbd0d-03f4-4481-b710-bd76c6f8586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34aa9b34-a6ac-48ca-a560-3eefc4565cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34aa9b34-a6ac-48ca-a560-3eefc4565cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0818d8-373c-438e-b664-fcba6212a86a', 'volume_name': 'volume-cf0818d8-373c-438e-b664-fcba6212a86a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d37510-85aa-41de-a592-87d8be647889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d37510-85aa-41de-a592-87d8be647889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6be42c-1f79-4bcd-8daa-c278145131c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Volume cf0818d8-373c-438e-b664-fcba6212a86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0818d8-373c-438e-b664-fcba6212a86a', 'volume_size': 1} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557046206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0818d8-373c-438e-b664-fcba6212a86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:56:02Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Creating volume cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:56:02 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:02 devstack sudo[115212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a 1073741824 Aug 20 06:56:02 devstack sudo[115212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:02 devstack sudo[115212]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a 1073741824" returned: 0 in 0.396s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:02 devstack sudo[115218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a Aug 20 06:56:02 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:02 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a" returned: 0 in 0.227s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6be42c-1f79-4bcd-8daa-c278145131c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0818d8-373c-438e-b664-fcba6212a86a', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533e9e99-67d8-455e-a8b4-3b841e9f636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:02 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Volume volume-cf0818d8-373c-438e-b664-fcba6212a86a (cf0818d8-373c-438e-b664-fcba6212a86a): created successfully Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533e9e99-67d8-455e-a8b4-3b841e9f636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:02 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (cf4a45f8-76ff-42b9-a340-6a15d0893c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:56:02 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-9e892b4a-cb5b-4bd3-bc90-fb43249e460f tempest-ProjectReaderTests-727202221 None] Created volume successfully. Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Creating offline snapshot 221e8978-5581-4a23-b9a4-d93762fd9fb9 of volume cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dac4d-4d07-4bfc-ac62-1d02d86400a9]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:03 devstack sudo[115221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a Aug 20 06:56:03 devstack sudo[115221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:03 devstack sudo[115221]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a" returned: 0 in 0.358s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:03 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 1G Aug 20 06:56:03 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:03 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 1G" returned: 0 in 0.383s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:03 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0818d8-373c-438e-b664-fcba6212a86a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:03 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0818d8-373c-438e-b664-fcba6212a86a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 Aug 20 06:56:03 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:04 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0818d8-373c-438e-b664-fcba6212a86a -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9" returned: 0 in 0.289s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:04 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 is being set with open permissions: ugo+rw Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:04 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 Aug 20 06:56:04 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:04 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:04 devstack sudo[115240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info Aug 20 06:56:04 devstack sudo[115240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:04 devstack sudo[115240]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:04 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info is being set with open permissions: ugo+rw Aug 20 06:56:04 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:04 devstack sudo[115243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info Aug 20 06:56:04 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:05 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.info" returned: 0 in 0.235s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:05 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-3d0dcb13-3d3f-4797-ba06-5fb42a1a5ee6 tempest-ProjectReaderTests-727202221 None] Create snapshot completed successfully Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-221e8978-5581-4a23-b9a4-d93762fd9fb9-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-221e8978-5581-4a23-b9a4-d93762fd9fb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-221e8978-5581-4a23-b9a4-d93762fd9fb9" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-221e8978-5581-4a23-b9a4-d93762fd9fb9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Deleting offline snapshot 221e8978-5581-4a23-b9a4-d93762fd9fb9 of volume cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] snapshot_file for this snap is: volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9053b56a-1865-4de1-9359-07f92d6be2f2]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:05 devstack sudo[115246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 Aug 20 06:56:05 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:05 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9" returned: 0 in 0.350s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf0818d8-373c-438e-b664-fcba6212a86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef93dead-8c5e-4256-a4aa-13a747348f29]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:05 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:05 devstack sudo[115251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a Aug 20 06:56:05 devstack sudo[115251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:06 devstack sudo[115251]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a" returned: 0 in 0.347s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:06 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 Aug 20 06:56:06 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:06 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9" returned: 0 in 0.334s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:06 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9 Aug 20 06:56:06 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:06 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a.221e8978-5581-4a23-b9a4-d93762fd9fb9" returned: 0 in 0.250s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-221e8978-5581-4a23-b9a4-d93762fd9fb9" released by "_delete_snapshot" :: held 1.371s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" released by "delete_snapshot" :: held 1.392s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Created reservations ['f14ce9df-be7f-4f29-aa16-7b0a70d97bbe', 'ed2fa19b-dd8b-41bb-9b28-0c61df5f8aae', '1cb09383-6dac-437f-afb2-995f4ed30e17', '7c3bb188-2cb7-4318-8392-774158dcb857'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:56:06 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Delete snapshot completed successfully. Aug 20 06:56:06 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-a90ab6b2-7676-4ea6-9304-cb9b0630d247 tempest-ProjectReaderTests-727202221 None] Lock "cinder-221e8978-5581-4a23-b9a4-d93762fd9fb9-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-cf0818d8-373c-438e-b664-fcba6212a86a-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "cinder-cf0818d8-373c-438e-b664-fcba6212a86a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" acquired by "delete_volume" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b0f42-f268-4731-b5fe-0161ab3541cd]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:07 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a Aug 20 06:56:07 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:07 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a" returned: 0 in 0.353s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:07 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:07 devstack sudo[115269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a Aug 20 06:56:07 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:08 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-cf0818d8-373c-438e-b664-fcba6212a86a" returned: 0 in 0.238s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-cf0818d8-373c-438e-b664-fcba6212a86a" released by "delete_volume" :: held 0.648s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Created reservations ['bd5956b9-f7f2-4f28-b5d8-6b1875443034', '38897f6a-352d-493e-8c95-2e375d634802', '8f1e71b2-3671-4d75-b245-2f75699455c6', '2f9fd8a0-2efa-4641-a2de-da29fcd3009d'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:08 devstack sudo[115273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:56:08 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:08 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.244s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:56:08 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Deleted volume successfully. Aug 20 06:56:08 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-1d519626-4653-4e7f-b45f-71189caeea1b tempest-ProjectReaderTests-727202221 None] Lock "cinder-cf0818d8-373c-438e-b664-fcba6212a86a-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (a048dad8-801b-4a6f-9598-03b65172b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25518d25-3b2a-453e-a9ce-96e8f7beee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25518d25-3b2a-453e-a9ce-96e8f7beee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703508999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0d6b80-0560-4f8c-921c-89be0da7c570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:56:09Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be9e85-67be-4b46-a2d9-63a2cfedbae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be9e85-67be-4b46-a2d9-63a2cfedbae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8ac528-3702-4651-b41f-a92a4ab23938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8ac528-3702-4651-b41f-a92a4ab23938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0d6b80-0560-4f8c-921c-89be0da7c570', 'volume_name': 'volume-6c0d6b80-0560-4f8c-921c-89be0da7c570', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99dd68a-bd4e-4e67-bc1d-63269a8db35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99dd68a-bd4e-4e67-bc1d-63269a8db35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a52cd7d-e4bb-4bd4-a690-8f97003b6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Volume 6c0d6b80-0560-4f8c-921c-89be0da7c570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0d6b80-0560-4f8c-921c-89be0da7c570', 'volume_size': 1} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-20T04:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703508999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0d6b80-0560-4f8c-921c-89be0da7c570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace588631c54483184854452eb855961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-20T04:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-20T04:56:09Z,use_quota=True,user_id='6bd26d2333d7405eb9b03c0c81324c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f83fdd15-74ca-41ce-bf8c-da9453f962d1),volume_type_id=f83fdd15-74ca-41ce-bf8c-da9453f962d1)}" {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Creating volume 6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Selected osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 as target Quobyte volume. {{(pid=94234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 20 06:56:09 devstack cinder-volume[94234]: INFO cinder.volume.drivers.remotefs [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] casted to osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2 Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 1073741824 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:09 devstack sudo[115276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 1073741824 Aug 20 06:56:09 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:09 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 1073741824" returned: 0 in 0.403s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:09 devstack sudo[115282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 Aug 20 06:56:09 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:09 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570" returned: 0 in 0.247s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'} {{(pid=94234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a52cd7d-e4bb-4bd4-a690-8f97003b6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0d6b80-0560-4f8c-921c-89be0da7c570', 'volume_size': 1}' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5bce46-5fba-494f-9a0e-942b406e220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 20 06:56:09 devstack cinder-volume[94234]: INFO cinder.volume.flows.manager.create_volume [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Volume volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 (6c0d6b80-0560-4f8c-921c-89be0da7c570): created successfully Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5bce46-5fba-494f-9a0e-942b406e220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 20 06:56:09 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Flow 'volume_create_manager' (a048dad8-801b-4a6f-9598-03b65172b977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 20 06:56:09 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-a769db01-a5cb-40e1-a2bf-8737d4a09692 tempest-ProjectReaderTests-727202221 None] Created volume successfully. Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Creating offline snapshot d5b5c968-5e33-4617-933f-3ceeeb3e1e1f of volume 6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a74f1e-b4a3-41c9-8274-0856bba07668]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:10 devstack sudo[115285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 Aug 20 06:56:10 devstack sudo[115285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:10 devstack sudo[115285]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570" returned: 0 in 0.357s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f 1G {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:10 devstack sudo[115290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f 1G Aug 20 06:56:10 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:10 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f 1G" returned: 0 in 0.379s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:10 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:11 devstack sudo[115295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f Aug 20 06:56:11 devstack sudo[115295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:11 devstack sudo[115295]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 -F qcow2 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" returned: 0 in 0.294s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:11 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f is being set with open permissions: ugo+rw Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:11 devstack sudo[115300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f Aug 20 06:56:11 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:11 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:11 devstack sudo[115303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info Aug 20 06:56:11 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:11 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info" returned: 0 in 0.253s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:11 devstack cinder-volume[94234]: WARNING cinder.volume.drivers.remotefs [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info is being set with open permissions: ugo+rw Aug 20 06:56:11 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:11 devstack sudo[115306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info Aug 20 06:56:11 devstack sudo[115306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:12 devstack sudo[115306]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.info" returned: 0 in 0.239s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:12 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-87035014-b43c-498f-8b29-105587d39fc7 tempest-ProjectReaderTests-727202221 None] Create snapshot completed successfully Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f-delete_snapshot" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" by "delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" by "_delete_snapshot" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Deleting offline snapshot d5b5c968-5e33-4617-933f-3ceeeb3e1e1f of volume 6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] snapshot_file for this snap is: volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d977a-01b7-4c69-80ce-54f63a39fbec]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:12 devstack sudo[115309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f Aug 20 06:56:12 devstack sudo[115309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:12 devstack sudo[115309]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" returned: 0 in 0.342s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.remotefs [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0d6b80-0560-4f8c-921c-89be0da7c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90cf32-dd3b-4ad8-bb4d-b9990b7bf78a]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:12 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:12 devstack sudo[115314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 Aug 20 06:56:12 devstack sudo[115314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:13 devstack sudo[115314]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570" returned: 0 in 0.346s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:13 devstack sudo[115319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f Aug 20 06:56:13 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:13 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" returned: 0 in 0.330s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:13 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f Aug 20 06:56:13 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:13 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570.d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" returned: 0 in 0.245s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f" released by "_delete_snapshot" :: held 1.348s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" released by "delete_snapshot" :: held 1.371s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Created reservations ['fffe79cf-a3b4-40c6-be64-889926b17e39', '6a50a526-072c-48e9-8e2c-1ff60463c4c4', '364ed490-7d0d-4713-80e1-8d2838ad3aa2', '362aa9e0-1785-449c-8c82-6690bbdeac3b'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:56:13 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Delete snapshot completed successfully. Aug 20 06:56:13 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-d7d20766-8322-4213-919c-c70663cc1023 tempest-ProjectReaderTests-727202221 None] Lock "cinder-d5b5c968-5e33-4617-933f-3ceeeb3e1e1f-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-6c0d6b80-0560-4f8c-921c-89be0da7c570-delete_volume" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "cinder-6c0d6b80-0560-4f8c-921c-89be0da7c570-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Acquiring lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" by "delete_volume" {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" acquired by "delete_volume" :: waited 0.017s {{(pid=94234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG oslo.privsep.daemon [-] privsep: reply[06828d85-4ff5-41f5-a5bb-7511fbbb00c6]: (4, 'qcow2') {{(pid=95471) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:14 devstack sudo[115327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 Aug 20 06:56:14 devstack sudo[115327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:14 devstack sudo[115327]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570" returned: 0 in 0.348s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:14 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:14 devstack sudo[115332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570 Aug 20 06:56:14 devstack sudo[115332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:15 devstack sudo[115332]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b/volume-6c0d6b80-0560-4f8c-921c-89be0da7c570" returned: 0 in 0.235s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "cinder-quobyte-6c0d6b80-0560-4f8c-921c-89be0da7c570" released by "delete_volume" :: held 0.640s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.quota [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Created reservations ['b1405de4-2f01-4b8f-b1b8-78472859608c', 'a601cdee-901f-4a4d-ad7c-7e4dba7facf3', '35ce269b-88fa-4c22-9dc8-5cefc2bff9ac', 'd425c186-890d-4de9-bfef-3b9947fa4d34'] {{(pid=94234) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:15 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:56:15 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:15 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.241s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:56:15 devstack cinder-volume[94234]: INFO cinder.volume.manager [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Deleted volume successfully. Aug 20 06:56:15 devstack cinder-volume[94234]: DEBUG cinder.coordination [None req-51d10912-bb18-48f5-951c-3f6b243cf3d5 tempest-ProjectReaderTests-727202221 None] Lock "cinder-6c0d6b80-0560-4f8c-921c-89be0da7c570-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94234) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 20 06:56:25 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:SELECT=111,cinder:INSERT=36,cinder:UPDATE=149,cinder:DELETE=13 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:56:25 devstack cinder-volume[94234]: DEBUG dbcounter [-] [94234] Writing DB stats cinder:DELETE=10,cinder:SELECT=107,cinder:INSERT=43,cinder:UPDATE=132 {{(pid=94234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2': None} {{(pid=94234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG cinder.volume.drivers.quobyte [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e625d7a8-745c-4468-999b-d763ba50c1a2'] {{(pid=94234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.lockutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 20 06:56:34 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b Aug 20 06:56:34 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 20 06:56:34 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_concurrency.processutils [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3ddfb1ad96b1a34f8e69bbac6b9b6d9b" returned: 0 in 0.254s {{(pid=94234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG cinder.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Notifying Schedulers of capabilities ... {{(pid=94234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG oslo_service.periodic_task [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] Running periodic task VolumeManager._thread_info {{(pid=94234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread count: 28 {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 20 06:56:34 devstack cinder-volume[94234]: DEBUG cinder.volume.manager [None req-1a23d1fa-a3c9-43eb-8dc9-45d9dcd09caf None None] thread info: [<_MainThread(MainThread, started 129594239836288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}